-- Logs begin at Wed 2022-11-02 11:33:11 UTC, end at Wed 2022-11-02 13:24:02 UTC. -- Nov 02 12:23:16.443702 n-d-857339-6 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:23:16.452803 n-d-857339-6 devstack@n-api.service[105189]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:23:16 2022] *** Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: nodename: n-d-857339-6 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: machine: x86_64 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: clock source: unix Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: pcre jit disabled Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: detected number of CPU cores: 4 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: current working directory: / Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: your processes number limit is 47680 Nov 02 12:23:16.455357 n-d-857339-6 devstack@n-api.service[105189]: your memory page size is 4096 bytes Nov 02 12:23:16.456037 n-d-857339-6 devstack@n-api.service[105189]: detected max file descriptor number: 2048 Nov 02 12:23:16.456037 n-d-857339-6 devstack@n-api.service[105189]: lock engine: pthread robust mutexes Nov 02 12:23:16.456037 n-d-857339-6 devstack@n-api.service[105189]: thunder lock: enabled Nov 02 12:23:16.456037 n-d-857339-6 devstack@n-api.service[105189]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:23:16.456037 n-d-857339-6 devstack@n-api.service[105189]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:23:16.494768 n-d-857339-6 devstack@n-api.service[105189]: Python main interpreter initialized at 0x55a0049c29c0 Nov 02 12:23:16.494768 n-d-857339-6 devstack@n-api.service[105189]: python threads support enabled Nov 02 12:23:16.494768 n-d-857339-6 devstack@n-api.service[105189]: your server socket listen backlog is limited to 100 connections Nov 02 12:23:16.494768 n-d-857339-6 devstack@n-api.service[105189]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:23:16.495171 n-d-857339-6 devstack@n-api.service[105189]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:23:16.495171 n-d-857339-6 devstack@n-api.service[105189]: *** Operational MODE: preforking *** Nov 02 12:23:16.495451 n-d-857339-6 devstack@n-api.service[105189]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:23:16.495451 n-d-857339-6 devstack@n-api.service[105189]: spawned uWSGI master process (pid: 105189) Nov 02 12:23:16.495680 n-d-857339-6 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:23:16.497140 n-d-857339-6 devstack@n-api.service[105189]: spawned uWSGI worker 1 (pid: 105190, cores: 1) Nov 02 12:23:16.497140 n-d-857339-6 devstack@n-api.service[105189]: spawned uWSGI worker 2 (pid: 105191, cores: 1) Nov 02 12:23:16.497337 n-d-857339-6 devstack@n-api.service[105189]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:23:17.169665 n-d-857339-6 devstack@n-api.service[105190]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:23:17.174762 n-d-857339-6 devstack@n-api.service[105191]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:23:18.319787 n-d-857339-6 devstack@n-api.service[105191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:23:18.319787 n-d-857339-6 devstack@n-api.service[105191]: from cryptography.utils import int_from_bytes Nov 02 12:23:18.320478 n-d-857339-6 devstack@n-api.service[105191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:23:18.320478 n-d-857339-6 devstack@n-api.service[105191]: from cryptography.utils import int_from_bytes Nov 02 12:23:18.331994 n-d-857339-6 devstack@n-api.service[105190]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:23:18.331994 n-d-857339-6 devstack@n-api.service[105190]: from cryptography.utils import int_from_bytes Nov 02 12:23:18.332849 n-d-857339-6 devstack@n-api.service[105190]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:23:18.332849 n-d-857339-6 devstack@n-api.service[105190]: from cryptography.utils import int_from_bytes Nov 02 12:23:20.927402 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:23:20.928060 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:23:20.928157 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:23:20.928539 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:23:20.928796 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:23:20.929186 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.929513 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.929833 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.930149 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.930475 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.930784 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.931106 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.931421 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.931748 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.932002 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.932318 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.932431 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:23:20.932831 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:23:20.932898 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857339-6 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.932984 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.933158 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:23:20.933256 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.933524 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:23:20.933620 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.933783 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:23:20.933918 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934150 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934246 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934518 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934626 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934800 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.934887 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.935136 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.935295 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.935469 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.935793 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936032 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936138 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936345 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936447 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936689 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.936792 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937023 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937122 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937338 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937440 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937651 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937740 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857339-6 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.937972 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938075 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938298 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938386 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938615 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938703 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.938923 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939024 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939232 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939327 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857339-6 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939579 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939755 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.939928 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940017 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940240 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940448 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940685 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940776 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.940999 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941092 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941305 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941394 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941639 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941805 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.941968 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942122 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942296 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942435 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942607 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942757 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.942922 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943067 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943239 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943392 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943555 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943704 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.943855 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944104 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857339-6 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944194 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944422 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944534 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944770 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.944866 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945077 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945163 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945422 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945590 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945693 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.945910 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946004 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946223 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946375 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946546 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946647 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946871 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.946959 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947118 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947218 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947366 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947500 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947684 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.947819 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948001 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948140 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948316 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948461 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948702 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.948860 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949013 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949172 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949321 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949484 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949632 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949802 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.949953 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950111 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950231 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950421 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950535 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950672 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950851 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.950982 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951166 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951345 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951527 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951669 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951837 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.951992 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952157 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952252 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952481 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952629 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952817 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.952914 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953125 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953220 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953434 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953527 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953744 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.953832 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.954586 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.954676 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.954897 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.954996 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955206 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955300 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955510 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955596 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955815 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.955910 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956120 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956206 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956434 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956539 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956777 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.956876 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957117 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957203 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957367 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957521 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957669 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957845 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.957975 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958243 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958331 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958497 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958592 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958807 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.958901 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.959146 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.959233 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.959467 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.959693 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.959782 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.960085 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.960240 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.960407 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.960686 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.960789 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961006 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961100 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961318 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961405 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961631 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961726 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.961939 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962026 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962247 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962334 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962497 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962592 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962846 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.962942 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963153 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963243 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963472 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963560 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963778 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.963873 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964083 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964168 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964388 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964554 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964718 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.964818 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965025 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965111 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965335 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965439 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965636 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965733 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.965941 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966034 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966250 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966340 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966554 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966639 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966858 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.966943 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967172 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967259 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967476 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967563 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967779 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.967865 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968093 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968179 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968557 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968748 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.968851 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.969056 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.969145 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.969364 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.969452 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.970248 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.970347 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.970557 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.970655 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971055 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971150 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971150 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971289 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971449 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971581 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971753 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.971894 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972058 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972204 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972358 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972545 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972705 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.972857 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973026 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973168 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973335 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973489 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973640 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973792 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.973975 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.974134 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.974294 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.974453 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.974630 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.974768 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.974960 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.975050 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.975300 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.975388 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.975614 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.975701 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.975934 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.976022 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.976241 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.976330 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.976568 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.976673 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.976883 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.976980 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.977186 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.977275 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.977506 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.977593 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.977814 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.977911 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.978125 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.978212 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.978431 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.978526 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.978740 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.978827 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.979053 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.979139 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:23:20.979380 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.979476 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.979696 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.979784 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980009 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980096 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980330 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980426 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980664 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980804 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.980981 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981140 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981304 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981463 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981625 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981778 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.981934 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982096 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982272 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982424 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982614 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982741 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.982927 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983055 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983249 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983346 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983570 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983669 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983880 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.983974 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984189 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984281 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984527 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984684 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984857 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.984956 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985190 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985278 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985544 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985675 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985824 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.985992 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986136 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986323 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986455 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986650 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986768 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.986972 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987069 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987315 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987404 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987662 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987750 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.987970 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988057 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988294 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988379 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988635 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988726 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.988952 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989042 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989266 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989352 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989579 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989664 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989894 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.989981 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.990212 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.990400 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.990522 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.990723 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.990821 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991093 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991261 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991412 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991502 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991724 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.991812 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992032 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992119 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992335 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992430 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992677 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992768 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.992990 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993077 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993295 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993382 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993625 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993714 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.993932 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994029 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994241 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994329 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994550 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994639 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994860 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.994942 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995163 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995258 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995471 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995559 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995783 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.995880 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996085 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996186 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996403 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996594 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996737 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.996834 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997068 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997210 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997406 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997497 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997712 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.997805 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998019 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998117 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998333 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998428 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998643 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998730 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.998953 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999050 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999267 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999356 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999578 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999668 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999899 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:20.999998 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000216 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000305 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000544 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000635 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000886 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.000983 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001201 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001289 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001509 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001597 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001827 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.001921 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002138 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002226 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002472 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002574 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002752 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.002840 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003061 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003149 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003365 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003462 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003667 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003866 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.003979 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004095 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004264 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004392 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004659 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004785 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.004895 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005011 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005196 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005341 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005498 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005658 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005799 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.005975 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006117 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006311 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006422 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006656 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006744 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.006969 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007066 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007297 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007386 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007627 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007715 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.007928 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008023 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008245 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008332 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008582 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008676 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008894 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.008995 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009204 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009294 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009512 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009600 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009826 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.009927 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010133 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010221 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010440 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010528 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010748 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.010837 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011054 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011142 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011360 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011448 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011675 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011763 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.011985 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012072 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012294 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012387 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012625 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012715 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.012934 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013024 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013264 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013405 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013570 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013667 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.013924 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014019 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014269 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014367 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014601 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014708 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.014919 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015009 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015240 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015337 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015553 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015641 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015868 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.015954 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.016177 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.016272 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017043 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017157 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017354 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017442 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017665 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017762 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.017981 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018066 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018289 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018375 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018608 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018699 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.018919 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019007 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019236 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019332 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019544 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019632 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019857 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.019944 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020182 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020269 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020516 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020609 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020860 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.020963 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021190 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021292 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021499 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021590 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021817 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.021949 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022136 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022235 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022444 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022540 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022754 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.022871 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023065 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023180 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023483 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023632 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023763 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023881 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.023988 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.024568 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.024673 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.024899 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.025082 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.025290 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.025489 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.025612 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.025944 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.026034 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.026257 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.026345 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.026580 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.026694 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027573 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027684 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027756 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027822 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027900 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.027981 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028050 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028115 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028181 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028340 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028460 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028638 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028806 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.028884 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029126 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029210 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029433 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029512 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029743 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.029819 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030058 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030146 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030370 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030458 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030679 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030768 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.030987 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031082 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031301 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031390 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031630 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031718 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.031943 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.032089 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.032828 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.032918 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.033139 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.033226 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.033454 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.033556 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034019 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034122 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034338 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034426 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034650 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034747 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.034964 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035094 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035329 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035458 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035642 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035732 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.035952 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036039 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036266 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036402 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036600 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036691 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.036962 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037054 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037271 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037356 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037618 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037709 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.037933 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038029 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038242 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038337 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038556 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038718 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038885 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.038973 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.039197 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.039295 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.039518 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.039606 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.039835 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040150 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040245 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040475 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040623 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040817 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.040950 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.041133 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.041276 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.041448 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.041622 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.041764 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042003 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042095 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042380 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042474 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042706 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.042795 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043018 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043106 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043326 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043414 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043637 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043766 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.043941 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044028 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044247 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044335 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044581 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044674 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.044921 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045218 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045356 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045523 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045612 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045832 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.045920 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046181 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046280 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046490 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046587 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046794 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.046894 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047098 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047189 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047443 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047540 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047775 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.047866 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048115 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048203 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048427 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048542 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048779 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.048867 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049090 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049185 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049399 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049494 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049708 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.049833 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050017 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050105 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050325 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050426 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050641 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050729 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.050949 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051044 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051257 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051346 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051566 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051654 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051874 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.051962 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052191 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052280 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052529 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052632 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052838 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.052926 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053147 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053237 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053497 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053591 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053808 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.053909 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054120 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054216 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054426 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054515 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054735 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.054832 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055079 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055167 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055388 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055475 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055731 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.055851 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056055 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056143 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056364 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056450 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056695 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.056798 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057019 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057111 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057329 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057418 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057632 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057728 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.057935 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058032 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058287 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058375 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058601 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058690 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.058917 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059014 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059238 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059333 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059537 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059698 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.059849 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060022 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060162 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060328 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060473 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060686 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.060807 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061030 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061122 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061348 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061451 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061661 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061749 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.061966 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062058 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062319 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062416 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062627 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062723 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.062943 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063032 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063269 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063359 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063582 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063669 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063896 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.063984 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064206 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064297 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064544 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064647 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064854 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.064995 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065161 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065249 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065468 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065554 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065781 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.065891 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066085 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066172 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066391 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066489 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066696 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.066797 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067005 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067092 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067306 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067395 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067609 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067707 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.067911 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068007 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068216 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068310 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068548 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068640 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068866 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.068955 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069190 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069278 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069577 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069666 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069884 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.069972 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070189 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070290 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070498 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070594 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070810 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.070898 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071118 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071204 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071452 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071580 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071739 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.071847 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072044 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072174 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072350 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072438 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072723 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.072812 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073033 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073166 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073369 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073465 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073686 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073773 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.073998 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074159 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074308 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074433 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074611 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074702 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.074916 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075023 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075237 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075333 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075550 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075728 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075844 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.075937 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076169 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076288 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076529 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076625 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076855 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.076948 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077171 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077264 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077479 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077565 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077785 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.077905 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078092 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078179 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078402 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078492 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078717 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.078808 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.079572 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.079667 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.079887 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.079976 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080212 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080310 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080537 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080639 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080850 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.080947 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081158 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081266 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081469 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081561 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081788 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.081889 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082088 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082186 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082407 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082499 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082708 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.082813 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083013 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083120 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083323 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083454 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083629 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083727 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.083955 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084058 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084243 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084334 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084578 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084761 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.084962 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085084 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085277 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085366 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085590 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085686 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085903 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.085991 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086248 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086387 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086532 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086629 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086856 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.086965 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087167 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087275 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087475 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087633 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087810 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.087938 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088095 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088246 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088408 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088578 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088743 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.088883 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089177 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089278 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089487 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089574 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089801 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.089945 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090153 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090275 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090451 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090550 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090755 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.090851 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091073 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091189 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091392 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091481 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091699 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.091834 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092119 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092213 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092535 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092643 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092849 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.092947 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093186 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093278 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093489 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093579 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093798 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.093906 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.094113 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.094203 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.094440 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.094566 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.095297 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.095388 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.095635 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.095749 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096027 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096165 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096335 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096508 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096690 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.096827 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097014 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097260 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097348 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097626 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097758 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.097932 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098024 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098253 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098437 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098573 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098681 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.098886 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099025 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099206 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099341 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099616 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099734 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.099936 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100026 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100252 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100353 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100601 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100708 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.100914 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101005 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101220 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101313 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101535 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101644 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101840 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.101929 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102144 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102233 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102449 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102637 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102756 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.102844 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103083 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103209 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103392 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103495 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103750 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.103862 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104012 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104101 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104316 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104466 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104688 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.104778 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105012 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105102 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105316 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105406 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105637 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105726 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.105952 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106079 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106273 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106363 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106592 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106684 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106896 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.106984 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107210 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107299 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107516 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107602 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107822 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.107909 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108129 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108219 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108435 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108543 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108800 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.108899 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109106 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109201 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109410 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109505 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109734 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.109830 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110043 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110180 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110386 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110475 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110704 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.110800 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111089 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111190 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111415 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111504 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111722 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.111817 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112037 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112125 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112348 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112442 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112676 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112774 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.112980 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113075 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113286 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113380 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113587 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113675 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113892 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.113987 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114195 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114283 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114541 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114631 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114848 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.114935 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115151 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115243 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115455 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115639 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115773 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.115976 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116108 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116306 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116399 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116649 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116742 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.116977 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117064 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117288 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117377 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117591 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117694 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117896 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.117990 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118212 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118302 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118520 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118616 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118833 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.118931 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119151 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119249 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119462 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119549 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119769 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.119871 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120074 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120163 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120380 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120468 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120725 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.120826 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121098 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121192 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121416 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121510 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121726 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.121827 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122034 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122131 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122345 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122433 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122653 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122819 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.122998 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123213 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123308 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123546 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123642 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123863 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.123951 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124179 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124266 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124537 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124649 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124831 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.124921 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125143 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125240 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125456 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125559 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125786 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.125938 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126109 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126242 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126434 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126524 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126747 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.126855 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127067 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127160 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127382 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127470 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127705 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.127801 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128023 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128261 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128365 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128621 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128714 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.128944 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129033 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129264 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129354 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129582 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129677 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.129929 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130024 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130212 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130320 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130528 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130615 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130841 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.130929 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131152 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131241 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131467 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131554 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131780 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.131877 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132094 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132183 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132407 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132547 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132741 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.132896 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133054 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133223 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133366 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133545 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133690 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.133867 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134022 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134186 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134342 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134546 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134644 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134866 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.134954 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.135179 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.135273 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.135498 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.135766 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.135865 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136079 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136167 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136413 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136585 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136826 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.136927 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137085 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137182 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137402 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137503 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137715 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.137802 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138030 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138125 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138332 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138429 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138638 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138727 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.138947 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139043 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139255 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139352 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139557 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139645 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139876 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.139964 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.140187 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.140276 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.140533 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.140625 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.140836 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.141046 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.141147 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.141368 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142207 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142305 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142544 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142631 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142861 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.142950 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143180 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143266 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143501 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143601 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143817 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.143906 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144126 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144224 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144434 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144553 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144770 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.144914 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145077 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145168 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145383 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145479 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145694 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145781 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.145999 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146088 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146304 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146440 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146617 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146741 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.146941 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147106 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147248 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147498 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147589 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147822 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.147910 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148153 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148290 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148587 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148690 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148775 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.148859 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149082 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149188 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149391 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149479 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149693 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149781 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.149996 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150094 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150300 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150388 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150602 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150692 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.150914 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151004 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151216 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151313 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151523 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151610 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151824 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.151912 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152135 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152223 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152439 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152544 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152779 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.152869 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153090 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153177 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153418 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153511 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153722 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.153812 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154024 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154113 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154329 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154429 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154640 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154729 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.154949 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155044 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155256 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155354 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155562 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155657 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155865 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.155959 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.156179 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.156276 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.156532 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.156801 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.156894 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.157175 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.157277 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.157655 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.158830 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.158830 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159138 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159225 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159314 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159406 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159489 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159569 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159658 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159786 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.159889 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160096 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160185 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160409 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160520 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160751 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.160951 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161061 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161188 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161373 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161472 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161683 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161781 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.161991 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.162078 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.162301 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.162390 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.162611 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.162924 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163028 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163227 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163317 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163536 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163640 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163844 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.163933 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164154 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164250 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164463 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164615 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164798 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.164888 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165122 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165209 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165441 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165530 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165754 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.165847 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166067 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166154 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166383 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166471 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166688 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.166776 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167000 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167111 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167308 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167430 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167619 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167721 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.167928 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168025 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168243 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168334 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168576 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168681 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168882 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.168981 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.169193 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.169508 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.169599 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.169823 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.169912 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170142 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170233 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170486 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170574 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170801 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.170897 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171121 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171211 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171443 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171532 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171751 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.171848 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172062 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172149 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172372 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172459 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172745 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.172850 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173087 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173177 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173413 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173509 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173737 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.173835 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174042 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174131 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174351 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174516 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174653 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.174963 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175130 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175280 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175456 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175576 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175784 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.175881 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176111 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176200 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176430 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176569 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176779 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.176875 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177083 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177171 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177388 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177555 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177693 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177784 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.177996 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178084 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178296 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178395 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178602 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178783 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.178900 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179120 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179208 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179450 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179542 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179763 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.179851 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180068 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180155 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180370 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180468 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180696 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.180802 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181000 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181098 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181307 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181429 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181608 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181699 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.181935 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182034 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182261 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182349 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182572 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182660 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182880 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.182978 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183188 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183275 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183492 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183580 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183800 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.183902 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184103 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184192 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184425 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184532 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184768 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.184859 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185080 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185168 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185410 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185501 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185717 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.185805 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186024 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186111 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186331 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186418 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186641 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186728 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.186949 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187044 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187255 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187361 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187586 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187687 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187906 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.187996 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188210 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188328 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188578 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188673 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188897 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.188986 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189284 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189400 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189528 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189604 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189840 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.189928 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190209 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190391 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190547 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190628 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190769 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.190854 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191078 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191156 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191393 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191470 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191703 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.191787 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192017 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192102 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192324 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192403 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192654 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192736 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.192970 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.193060 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.196918 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197086 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197180 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197329 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197424 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197515 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197624 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197765 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197857 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.197948 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198040 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198121 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198121 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198276 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198356 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198451 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198533 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198613 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198693 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198772 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198850 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.198938 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199025 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199107 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199186 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199266 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199266 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105190) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199415 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199848 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.199848 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.200169 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.200515 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.200856 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.201205 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.201524 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.201875 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.202206 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.202526 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.202841 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.203151 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:23:21.203397 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:23:21.351492 n-d-857339-6 devstack@n-api.service[105190]: INFO dbcounter [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Registered counter for database nova_api Nov 02 12:23:21.360427 n-d-857339-6 devstack@n-api.service[105191]: INFO dbcounter [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Registered counter for database nova_api Nov 02 12:23:21.373032 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_db.sqlalchemy.engines [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.380508 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writer thread running {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.383241 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_db.sqlalchemy.engines [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.390166 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writer thread running {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.437646 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.context [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=105190) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:23:21.442094 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.442564 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.444208 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.444971 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.445411 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.447456 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.448711 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.context [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=105191) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:23:21.449520 n-d-857339-6 devstack@n-api.service[105190]: INFO dbcounter [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Registered counter for database nova_cell0 Nov 02 12:23:21.452598 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.453080 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.453633 n-d-857339-6 devstack@n-api.service[105190]: INFO dbcounter [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Registered counter for database nova_cell1 Nov 02 12:23:21.454761 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.455977 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:23:21.456434 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:23:21.458653 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_concurrency.lockutils [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105191) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:23:21.460735 n-d-857339-6 devstack@n-api.service[105191]: INFO dbcounter [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Registered counter for database nova_cell0 Nov 02 12:23:21.462225 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_db.sqlalchemy.engines [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.464108 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_db.sqlalchemy.engines [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.465322 n-d-857339-6 devstack@n-api.service[105191]: INFO dbcounter [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Registered counter for database nova_cell1 Nov 02 12:23:21.470105 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writer thread running {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.472431 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writer thread running {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.473075 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_db.sqlalchemy.engines [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.474346 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_db.sqlalchemy.engines [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.481937 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writer thread running {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.482279 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writer thread running {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.618035 n-d-857339-6 devstack@n-api.service[105190]: INFO dbcounter [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Registered counter for database nova_cell0 Nov 02 12:23:21.629864 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_db.sqlalchemy.engines [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105190) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.634893 n-d-857339-6 devstack@n-api.service[105191]: INFO dbcounter [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Registered counter for database nova_cell0 Nov 02 12:23:21.635105 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writer thread running {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:21.641937 n-d-857339-6 devstack@n-api.service[105191]: DEBUG oslo_db.sqlalchemy.engines [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:23:21.646785 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writer thread running {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:23:22.049125 n-d-857339-6 devstack@n-api.service[105190]: WARNING keystonemiddleware.auth_token [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:23:22.056462 n-d-857339-6 devstack@n-api.service[105190]: WARNING keystonemiddleware.auth_token [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:23:22.064972 n-d-857339-6 devstack@n-api.service[105191]: WARNING keystonemiddleware.auth_token [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:23:22.072168 n-d-857339-6 devstack@n-api.service[105191]: WARNING keystonemiddleware.auth_token [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:23:22.410287 n-d-857339-6 devstack@n-api.service[105190]: WARNING keystonemiddleware.auth_token [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:23:22.416323 n-d-857339-6 devstack@n-api.service[105190]: WARNING keystonemiddleware.auth_token [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:23:22.421660 n-d-857339-6 devstack@n-api.service[105190]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a0049c29c0 pid: 105190 (default app) Nov 02 12:23:22.422298 n-d-857339-6 devstack@n-api.service[105191]: WARNING keystonemiddleware.auth_token [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:23:22.423857 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:22.425048 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 Nov 02 12:23:22.425491 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Nov 2 12:23:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:22.428402 n-d-857339-6 devstack@n-api.service[105191]: WARNING keystonemiddleware.auth_token [None req-12e75622-e134-46eb-a151-21fefb21a43c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:23:22.433826 n-d-857339-6 devstack@n-api.service[105191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a0049c29c0 pid: 105191 (default app) Nov 02 12:24:50.142996 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:50.145536 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003238 Nov 02 12:24:50.146173 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:50.166667 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_api:SELECT=3 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.167866 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_cell1:SELECT=3 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.169464 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_cell0:SELECT=3 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:50.170628 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:51.058343 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-d42c8f84-ab79-4ecd-87c3-3c0c40cbe98a admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:51.090903 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-d42c8f84-ab79-4ecd-87c3-3c0c40cbe98a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.933431 Nov 02 12:24:51.092624 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Nov 2 12:24:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:53.828815 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:53.829796 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-1162d4c8-7d0d-47d3-82fc-8ff8171bda72 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Nov 02 12:24:53.830884 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:24:54.293532 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-6e599c8b-2cca-4138-8c70-6cb25c5b917b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "swap": 0}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:54.405691 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-6e599c8b-2cca-4138-8c70-6cb25c5b917b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.568597 Nov 02 12:24:54.406280 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:24:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:24:54.420345 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_api:SELECT=3 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:54.421294 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_cell1:SELECT=3 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:54.423373 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_cell0:SELECT=3 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:54.424707 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:24:54.636984 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-747ae860-8ed4-4834-8ebf-021aef1b42d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:54.775746 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-747ae860-8ed4-4834-8ebf-021aef1b42d1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.360709 Nov 02 12:24:54.776346 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Nov 2 12:24:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:24:57.422965 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-6e599c8b-2cca-4138-8c70-6cb25c5b917b admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:24:57.424738 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-6e599c8b-2cca-4138-8c70-6cb25c5b917b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Nov 02 12:24:57.425264 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:24:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:24:58.205756 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-9a9aafae-6d2e-4d60-9c78-23d609ccfb6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:58.366378 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-9a9aafae-6d2e-4d60-9c78-23d609ccfb6d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.934205 Nov 02 12:24:58.372523 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:24:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:24:58.380376 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-d1bd8878-679f-4cd1-8cb0-d4492884be9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:24:58.503574 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-d1bd8878-679f-4cd1-8cb0-d4492884be9f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127007 Nov 02 12:24:58.505655 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Nov 2 12:24:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:01.356335 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-9a9aafae-6d2e-4d60-9c78-23d609ccfb6d admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:01.357587 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-9a9aafae-6d2e-4d60-9c78-23d609ccfb6d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001845 Nov 02 12:25:01.358035 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:02.033253 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-c6d62444-ee11-4e79-866e-4b1865b96245 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "id": "d2"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:02.545279 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-c6d62444-ee11-4e79-866e-4b1865b96245 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.179789 Nov 02 12:25:02.558504 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:25:02.559296 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-090d7900-c6e6-48d7-9f0f-d91db7a47f79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:02.694065 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-090d7900-c6e6-48d7-9f0f-d91db7a47f79 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138679 Nov 02 12:25:02.703322 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Nov 2 12:25:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:05.394213 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-c6d62444-ee11-4e79-866e-4b1865b96245 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:05.395234 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-c6d62444-ee11-4e79-866e-4b1865b96245 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 02 12:25:05.396116 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:05.910246 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-0988d6ed-58bb-4490-b03a-17a12aa860cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:05.997805 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-0988d6ed-58bb-4490-b03a-17a12aa860cd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.594737 Nov 02 12:25:05.999027 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:25:06.011687 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-bad0e917-e037-48fb-baff-2dd0383350e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:06.126851 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-bad0e917-e037-48fb-baff-2dd0383350e8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118680 Nov 02 12:25:06.129001 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Nov 2 12:25:06 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:09.045128 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-0988d6ed-58bb-4490-b03a-17a12aa860cd admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:09.047486 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-0988d6ed-58bb-4490-b03a-17a12aa860cd admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002862 Nov 02 12:25:09.048277 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:09.548513 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:09.641699 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.582233 Nov 02 12:25:09.652084 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:25:09.655591 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-8a184f5a-8e96-4f30-8215-51e901334ec5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:09.759520 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-8a184f5a-8e96-4f30-8215-51e901334ec5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107362 Nov 02 12:25:09.761878 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Nov 2 12:25:09 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:12.754672 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:12.758104 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Nov 02 12:25:12.758104 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:13.220895 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-cf8d8f39-cb38-400d-8f96-87a4120b05e4 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:13.246940 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-cf8d8f39-cb38-400d-8f96-87a4120b05e4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.482169 Nov 02 12:25:13.249996 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Nov 2 12:25:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:16.068845 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:16.069775 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-eb7270d8-c993-4d80-82ef-9ab2afc424aa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Nov 02 12:25:16.070178 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:25:16.577480 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-4327eb3c-231a-4864-a176-6da0ae2f824b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "id": "1", "vcpus": 1}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:16.659303 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-4327eb3c-231a-4864-a176-6da0ae2f824b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.580512 Nov 02 12:25:16.660097 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:25:16.673214 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-f3915e2f-874b-4e3a-8dde-da374002aa30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:16.768402 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-f3915e2f-874b-4e3a-8dde-da374002aa30 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098350 Nov 02 12:25:16.768963 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Nov 2 12:25:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:19.909950 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-4327eb3c-231a-4864-a176-6da0ae2f824b admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:19.910961 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-4327eb3c-231a-4864-a176-6da0ae2f824b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Nov 02 12:25:19.911373 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:20.387955 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-77ae719e-15ff-4da1-a8e8-f6dfb595894d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "swap": 0, "name": "m1.small", "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:20.395877 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:20.568177 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-77ae719e-15ff-4da1-a8e8-f6dfb595894d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.649877 Nov 02 12:25:20.568790 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:25:20.582130 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-50f7320f-b03b-4652-8ccc-b3c2c129b494 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:20.681672 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-50f7320f-b03b-4652-8ccc-b3c2c129b494 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104030 Nov 02 12:25:20.682229 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Nov 2 12:25:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:23.371980 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-77ae719e-15ff-4da1-a8e8-f6dfb595894d admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:23.373024 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-77ae719e-15ff-4da1-a8e8-f6dfb595894d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Nov 02 12:25:23.373446 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:23.793541 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-354fa6e1-a1dc-48b0-a0f8-68eb049c35ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:24.534909 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-354fa6e1-a1dc-48b0-a0f8-68eb049c35ed admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 1.154815 Nov 02 12:25:24.535540 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:25:24.548088 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-9766fd05-cd47-4af3-9567-c111b97d0cf9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:24.720297 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-9766fd05-cd47-4af3-9567-c111b97d0cf9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.175905 Nov 02 12:25:24.721778 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Nov 2 12:25:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:27.473427 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-354fa6e1-a1dc-48b0-a0f8-68eb049c35ed admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:27.475295 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-354fa6e1-a1dc-48b0-a0f8-68eb049c35ed admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Nov 02 12:25:27.475485 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:27.982598 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-2dea0d0d-5d9a-419e-9e67-115e311fff5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:28.060383 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-2dea0d0d-5d9a-419e-9e67-115e311fff5a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.578133 Nov 02 12:25:28.061689 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:25:28.076616 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-d38e58c4-4aba-45c3-be8f-6938bcaa14c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:28.083216 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:28.220976 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-d38e58c4-4aba-45c3-be8f-6938bcaa14c5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148029 Nov 02 12:25:28.221907 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Nov 2 12:25:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:30.885038 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-2dea0d0d-5d9a-419e-9e67-115e311fff5a admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:30.886056 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-2dea0d0d-5d9a-419e-9e67-115e311fff5a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 02 12:25:30.886636 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:31.347044 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:31.426805 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.533650 Nov 02 12:25:31.427813 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Nov 2 12:25:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:25:31.446811 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-10fa6b5c-2bf5-4767-b389-fb9e2d54d6bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:25:31.537712 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-10fa6b5c-2bf5-4767-b389-fb9e2d54d6bd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097958 Nov 02 12:25:31.538484 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Nov 2 12:25:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:25:52.422854 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.423930 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 02 12:25:52.424328 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:52.437845 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:52.842884 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-bd8bd4e3-c4f2-48f4-9c0c-51f0148a3b3f admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:52.859469 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-bd8bd4e3-c4f2-48f4-9c0c-51f0148a3b3f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.428107 Nov 02 12:25:52.860030 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Nov 2 12:25:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:54.167431 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.168437 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-dce6d562-6117-4f83-a818-da452aed83a2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 02 12:25:54.168878 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:54.719544 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ee3d4b4e-6490-4f12-82de-5fa78e3eddc9 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.724901 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.wsgi [None req-ee3d4b4e-6490-4f12-82de-5fa78e3eddc9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ee3d4b4e-6490-4f12-82de-5fa78e3eddc9 admin admin] Request method failure captured: Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Accept: application/json Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Accept-Encoding: gzip, deflate Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Connection: keep-alive Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Content-Length: 0 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Host: 10.222.0.64 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: Openstack-System-Scope: None Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: User-Agent: python-novaclient Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Auth-Token: gAAAAABjYmHSWSO4WIitybui2YJhJJesfzFBBIEvhmrrLkTJmwTKaZL-yO-ntjfj6PUzdZv-TjFgHjTotu-hYRdGO8GYxqaMCijyY4cWrl3fVNxkGOhaacgA4q0VFv-KdNf21XAC8NsEcqqhe4bEVgfoJz_UqTgEBrkznbR_2PNqRVfk8DtlWS4 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Id: None Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Name: None Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Identity-Status: Confirmed Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Is-Admin-Project: True Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Id: default Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Name: Default Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Name: admin Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Role: reader,admin,member Nov 02 12:25:54.728089 n-d-857339-6 devstack@n-api.service[105191]: X-Roles: reader,admin,member Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant: admin Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Name: admin Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-User: admin Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Id: default Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Name: Default Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: X-User-Name: admin Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: method: > Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: exception: Flavor 42 could not be found. Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: action_args: {'id': '42'} Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:54.729833 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:54.730851 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.732254 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ee3d4b4e-6490-4f12-82de-5fa78e3eddc9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:54.733596 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-ee3d4b4e-6490-4f12-82de-5fa78e3eddc9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.398952 Nov 02 12:25:54.733596 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:54.739138 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-00374f52-7b79-436b-bec0-83cf701f9b3c admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.743172 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:25:54.762038 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-00374f52-7b79-436b-bec0-83cf701f9b3c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026426 Nov 02 12:25:54.763675 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:54.778540 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-c2bfc935-dac0-4f77-a902-4716c1af534a admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.801020 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-c2bfc935-dac0-4f77-a902-4716c1af534a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027077 Nov 02 12:25:54.801566 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:54.811034 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-2cee84df-3597-427c-ac08-d587e278158f admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:54.817596 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.wsgi [None req-2cee84df-3597-427c-ac08-d587e278158f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-2cee84df-3597-427c-ac08-d587e278158f admin admin] Request method failure captured: Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Accept: application/json Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Accept-Encoding: gzip, deflate Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Connection: keep-alive Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Content-Length: 0 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Host: 10.222.0.64 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: Openstack-System-Scope: None Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: User-Agent: python-novaclient Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Auth-Token: gAAAAABjYmHSWSO4WIitybui2YJhJJesfzFBBIEvhmrrLkTJmwTKaZL-yO-ntjfj6PUzdZv-TjFgHjTotu-hYRdGO8GYxqaMCijyY4cWrl3fVNxkGOhaacgA4q0VFv-KdNf21XAC8NsEcqqhe4bEVgfoJz_UqTgEBrkznbR_2PNqRVfk8DtlWS4 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Id: None Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Name: None Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Identity-Status: Confirmed Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Is-Admin-Project: True Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Id: default Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Name: Default Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Name: admin Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Role: reader,admin,member Nov 02 12:25:54.820898 n-d-857339-6 devstack@n-api.service[105190]: X-Roles: reader,admin,member Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant: admin Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Name: admin Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-User: admin Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Id: default Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Name: Default Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: X-User-Name: admin Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: method: > Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: exception: Flavor 42 could not be found. Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: action_args: {'id': '42'} Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:54.822454 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:54.823405 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:54.824737 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-2cee84df-3597-427c-ac08-d587e278158f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:54.832225 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-2cee84df-3597-427c-ac08-d587e278158f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014944 Nov 02 12:25:54.832225 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 2 12:25:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:56.048283 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-c2bfc935-dac0-4f77-a902-4716c1af534a admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.049922 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-c2bfc935-dac0-4f77-a902-4716c1af534a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Nov 02 12:25:56.051358 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:56.585292 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-6dba4d62-fde1-483f-b5aa-c230f4d19a18 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.590831 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.wsgi [None req-6dba4d62-fde1-483f-b5aa-c230f4d19a18 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-6dba4d62-fde1-483f-b5aa-c230f4d19a18 admin admin] Request method failure captured: Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Accept: application/json Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Accept-Encoding: gzip, deflate Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Connection: keep-alive Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Content-Length: 0 Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Host: 10.222.0.64 Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: Openstack-System-Scope: None Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: User-Agent: python-novaclient Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Auth-Token: gAAAAABjYmHT9MhZrSvmrnLV9zj5CGTGqjC2psdD3dbAWnx_Riydx9s-z0HMDvxd2qn3WodKNkLC1yayi17wvGhUUz011uQDIkOFWJqqA7joPeRkPyhMQuN56kbrp-AAzMhbZJsbEgZeq-WH-B8y3yZa9cPbVQJ3AW1pJIZii3UHul_IgdqHqHI Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Id: None Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Name: None Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Identity-Status: Confirmed Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Is-Admin-Project: True Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Id: default Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Name: Default Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Name: admin Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Role: reader,admin,member Nov 02 12:25:56.592349 n-d-857339-6 devstack@n-api.service[105190]: X-Roles: reader,admin,member Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant: admin Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Name: admin Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-User: admin Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Id: default Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Name: Default Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: X-User-Name: admin Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: method: > Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: exception: Flavor 84 could not be found. Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: action_args: {'id': '84'} Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:56.593939 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:56.594896 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.596656 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-6dba4d62-fde1-483f-b5aa-c230f4d19a18 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:56.597697 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-6dba4d62-fde1-483f-b5aa-c230f4d19a18 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.404731 Nov 02 12:25:56.597697 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:56.604310 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-9147cd83-79ae-489e-97b9-ac81820d6f3e admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.620199 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-9147cd83-79ae-489e-97b9-ac81820d6f3e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019580 Nov 02 12:25:56.620922 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:25:56.631192 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-b63fd480-5875-4acd-872a-103d198c3eaa admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.648046 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-b63fd480-5875-4acd-872a-103d198c3eaa admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020421 Nov 02 12:25:56.648649 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:56.659396 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-e58592b4-a134-4282-92f8-8e4a930a7a90 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:56.664673 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.wsgi [None req-e58592b4-a134-4282-92f8-8e4a930a7a90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-e58592b4-a134-4282-92f8-8e4a930a7a90 admin admin] Request method failure captured: Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Accept: application/json Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Accept-Encoding: gzip, deflate Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Connection: keep-alive Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Content-Length: 0 Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Host: 10.222.0.64 Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: Openstack-System-Scope: None Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: User-Agent: python-novaclient Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Auth-Token: gAAAAABjYmHT9MhZrSvmrnLV9zj5CGTGqjC2psdD3dbAWnx_Riydx9s-z0HMDvxd2qn3WodKNkLC1yayi17wvGhUUz011uQDIkOFWJqqA7joPeRkPyhMQuN56kbrp-AAzMhbZJsbEgZeq-WH-B8y3yZa9cPbVQJ3AW1pJIZii3UHul_IgdqHqHI Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Id: None Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Name: None Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Identity-Status: Confirmed Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Is-Admin-Project: True Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Id: default Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Name: Default Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Name: admin Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Role: reader,admin,member Nov 02 12:25:56.666182 n-d-857339-6 devstack@n-api.service[105191]: X-Roles: reader,admin,member Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant: admin Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Name: admin Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-User: admin Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Id: default Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Name: Default Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: X-User-Name: admin Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: method: > Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: exception: Flavor 84 could not be found. Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: action_args: {'id': '84'} Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:56.667748 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:56.668620 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:56.669715 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-e58592b4-a134-4282-92f8-8e4a930a7a90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:56.670718 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-e58592b4-a134-4282-92f8-8e4a930a7a90 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012769 Nov 02 12:25:56.670718 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 2 12:25:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:57.888883 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-b63fd480-5875-4acd-872a-103d198c3eaa admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:57.889890 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-b63fd480-5875-4acd-872a-103d198c3eaa admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Nov 02 12:25:57.890288 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:25:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:25:58.438712 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-75972983-a7fe-4e44-8f52-41b27c3179f1 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.445338 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.wsgi [None req-75972983-a7fe-4e44-8f52-41b27c3179f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-75972983-a7fe-4e44-8f52-41b27c3179f1 admin admin] Request method failure captured: Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Accept: application/json Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Accept-Encoding: gzip, deflate Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Connection: keep-alive Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Content-Length: 0 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Host: 10.222.0.64 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: Openstack-System-Scope: None Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: User-Agent: python-novaclient Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Auth-Token: gAAAAABjYmHVg12Q44nx3GEKO1fZKoLjGgQH_b9TxTnvb3cvR0IFZrPCftr65_SNjAjDJfEvmSKJMLo8Tbo4kfTTw8sHFZ4FwjBt2QgCw5D4xHSg5KsMDSvgH1PkAnrdKuW9yUCU3pWUKFWKDM-NTut3YlN1XEbrd2u_NjOwsrEhmmTezxoZtS4 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Id: None Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Domain-Name: None Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Identity-Status: Confirmed Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Is-Admin-Project: True Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Id: default Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Domain-Name: Default Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Project-Name: admin Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Role: reader,admin,member Nov 02 12:25:58.446831 n-d-857339-6 devstack@n-api.service[105191]: X-Roles: reader,admin,member Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant: admin Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-Tenant-Name: admin Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-User: admin Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Id: default Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-User-Domain-Name: Default Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: X-User-Name: admin Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: method: > Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: exception: Flavor 451 could not be found. Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: action_args: {'id': '451'} Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:58.449458 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:58.450959 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.452963 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-75972983-a7fe-4e44-8f52-41b27c3179f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105191) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:58.455683 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-75972983-a7fe-4e44-8f52-41b27c3179f1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.420296 Nov 02 12:25:58.455683 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 421 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:58.458605 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-2de8d077-731b-41fe-ba61-1f9195094867 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.473726 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-2de8d077-731b-41fe-ba61-1f9195094867 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019171 Nov 02 12:25:58.474324 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:25:58.485667 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.500855 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019275 Nov 02 12:25:58.501584 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:25:58.512283 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-54b25b39-6c4a-4393-a355-9f8ff3beaaa9 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:58.518140 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.wsgi [None req-54b25b39-6c4a-4393-a355-9f8ff3beaaa9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-54b25b39-6c4a-4393-a355-9f8ff3beaaa9 admin admin] Request method failure captured: Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Accept: application/json Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Accept-Encoding: gzip, deflate Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Connection: keep-alive Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Content-Length: 0 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Host: 10.222.0.64 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Openstack-Api-Version: compute 2.92 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: Openstack-System-Scope: None Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: User-Agent: python-novaclient Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Auth-Token: gAAAAABjYmHVg12Q44nx3GEKO1fZKoLjGgQH_b9TxTnvb3cvR0IFZrPCftr65_SNjAjDJfEvmSKJMLo8Tbo4kfTTw8sHFZ4FwjBt2QgCw5D4xHSg5KsMDSvgH1PkAnrdKuW9yUCU3pWUKFWKDM-NTut3YlN1XEbrd2u_NjOwsrEhmmTezxoZtS4 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Id: None Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Domain-Name: None Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Identity-Status: Confirmed Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Is-Admin-Project: True Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Id: default Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Domain-Name: Default Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Project-Name: admin Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Role: reader,admin,member Nov 02 12:25:58.519678 n-d-857339-6 devstack@n-api.service[105190]: X-Roles: reader,admin,member Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a77a9a466b3c4a1db84a2273ce5d6a0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a77a9a466b3c4a1db84a2273ce5d6a0e"}]}] Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant: admin Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Id: a77a9a466b3c4a1db84a2273ce5d6a0e Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-Tenant-Name: admin Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-User: admin Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Id: default Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-User-Domain-Name: Default Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-User-Id: d787a32a40cf4bfab2a0a7e140cad17b Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: X-User-Name: admin Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: method: > Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: exception: Flavor 451 could not be found. Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: action_args: {'id': '451'} Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:25:58.521212 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:58.521986 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: ERROR nova.api.openstack.wsgi Nov 02 12:25:58.523271 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-54b25b39-6c4a-4393-a355-9f8ff3beaaa9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105190) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:25:58.524546 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-54b25b39-6c4a-4393-a355-9f8ff3beaaa9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012899 Nov 02 12:25:58.524546 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:25:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:25:59.764397 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:25:59.765445 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 02 12:25:59.765845 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:25:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:00.340473 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-00f6944d-1a0a-4eea-a8ae-d9b5b2ba3dca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:00.449400 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-00f6944d-1a0a-4eea-a8ae-d9b5b2ba3dca admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.544421 Nov 02 12:26:00.449964 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 2 12:25:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:01.712052 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:01.713142 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 02 12:26:01.713546 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:26:02.272927 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-b7740432-05b6-485a-a7f0-db569a7acb41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:02.357440 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-b7740432-05b6-485a-a7f0-db569a7acb41 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.506360 Nov 02 12:26:02.358009 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 2 12:26:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:26:03.653736 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:03.654791 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Nov 02 12:26:03.655168 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:04.246032 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-f71951ad-85fa-4e8d-aa07-3492107e4b61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:04.351971 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-f71951ad-85fa-4e8d-aa07-3492107e4b61 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.559351 Nov 02 12:26:04.352553 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 2 12:26:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:05.603687 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:05.604732 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Nov 02 12:26:05.605135 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:06.169491 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-3b5ed525-6d89-43e3-b990-b5c9284e8f61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:26:06.285261 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-3b5ed525-6d89-43e3-b990-b5c9284e8f61 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.541520 Nov 02 12:26:06.285862 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Nov 2 12:26:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:07.541904 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:07.542962 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 02 12:26:07.543369 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:08.110956 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-4a05442c-9a35-4244-b726-88aa189a716a admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:08.132165 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-4a05442c-9a35-4244-b726-88aa189a716a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.450027 Nov 02 12:26:08.132738 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Nov 2 12:26:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:06.492428 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.493485 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-4c91cf87-55cb-4246-8753-a785744b2820 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Nov 02 12:27:06.493887 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 931 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:06.504919 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:06.897296 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-f9d49283-f366-4cda-a411-7e9e9eb2f7c5 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.918832 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-f9d49283-f366-4cda-a411-7e9e9eb2f7c5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.418450 Nov 02 12:27:06.919377 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:27:06.940777 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_api:SELECT=14 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:06.944505 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-18fc4305-1470-4ecc-b380-d82b873696cb admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.952420 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-18fc4305-1470-4ecc-b380-d82b873696cb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012507 Nov 02 12:27:06.955760 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:06.965560 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-d7db8e59-0f91-432b-9dfe-8c2c9d64f828 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.973655 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-d7db8e59-0f91-432b-9dfe-8c2c9d64f828 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011732 Nov 02 12:27:06.974188 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:06.986593 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:06.994077 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011607 Nov 02 12:27:06.994610 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Nov 2 12:27:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:27:07.007054 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-962ccfb8-1bca-4605-9b44-f31034282884 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:07.014434 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-962ccfb8-1bca-4605-9b44-f31034282884 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010925 Nov 02 12:27:07.014971 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Nov 2 12:27:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:01.998441 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:01.999454 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 02 12:33:01.999856 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:33:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:02.143323 n-d-857339-6 devstack@n-api.service[105190]: DEBUG dbcounter [-] [105190] Writing DB stats nova_api:SELECT=6 {{(pid=105190) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:02.291232 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:02.295985 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.296452 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.296902 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.297634 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:02.298071 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:02.298486 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:02.337602 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-d330f062-c586-4319-b285-ffe021c7b74f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.195966 Nov 02 12:33:02.338174 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:33:02 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:03.443947 n-d-857339-6 devstack@n-api.service[105191]: DEBUG nova.api.openstack.wsgi [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] Calling method '>' {{(pid=105191) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:03.445122 n-d-857339-6 devstack@n-api.service[105191]: INFO nova.api.openstack.requestlog [None req-ec36bc83-98f5-4703-b65a-3d6247644116 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Nov 02 12:33:03.445607 n-d-857339-6 devstack@n-api.service[105191]: [pid: 105191|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Nov 2 12:33:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:03.640567 n-d-857339-6 devstack@n-api.service[105190]: DEBUG nova.api.openstack.wsgi [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Calling method '>' {{(pid=105190) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:03.645010 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.645486 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.645912 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.646629 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:03.647072 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:03.647483 n-d-857339-6 devstack@n-api.service[105190]: DEBUG oslo_concurrency.lockutils [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105190) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:03.670579 n-d-857339-6 devstack@n-api.service[105190]: INFO nova.api.openstack.requestlog [None req-59f7c811-3ffd-4bec-8702-465eb38f9967 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.083046 Nov 02 12:33:03.671256 n-d-857339-6 devstack@n-api.service[105190]: [pid: 105190|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:33:03 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:56.354312 n-d-857339-6 devstack@n-api.service[105189]: Wed Nov 2 12:33:56 2022 - graceful shutdown triggered... Nov 02 12:33:56.354406 n-d-857339-6 systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 12:33:56.355508 n-d-857339-6 devstack@n-api.service[105190]: Gracefully killing worker 1 (pid: 105190)... Nov 02 12:33:56.355967 n-d-857339-6 devstack@n-api.service[105191]: Gracefully killing worker 2 (pid: 105191)... Nov 02 12:33:56.483925 n-d-857339-6 devstack@n-api.service[105191]: DEBUG dbcounter [-] [105191] Writing DB stats nova_api:SELECT=4 {{(pid=105191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:57.356613 n-d-857339-6 devstack@n-api.service[105189]: worker 1 buried after 1 seconds Nov 02 12:33:57.356613 n-d-857339-6 devstack@n-api.service[105189]: worker 2 buried after 1 seconds Nov 02 12:33:57.356613 n-d-857339-6 devstack@n-api.service[105189]: goodbye to uWSGI. Nov 02 12:33:57.358246 n-d-857339-6 systemd[1]: devstack@n-api.service: Succeeded. Nov 02 12:33:57.358854 n-d-857339-6 systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 12:33:57.362249 n-d-857339-6 systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:33:57.377468 n-d-857339-6 devstack@n-api.service[127754]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:33:57 2022] *** Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: nodename: n-d-857339-6 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: machine: x86_64 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: clock source: unix Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: pcre jit disabled Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: detected number of CPU cores: 4 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: current working directory: / Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: your processes number limit is 47680 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: your memory page size is 4096 bytes Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: detected max file descriptor number: 2048 Nov 02 12:33:57.395785 n-d-857339-6 devstack@n-api.service[127754]: lock engine: pthread robust mutexes Nov 02 12:33:57.397313 n-d-857339-6 devstack@n-api.service[127754]: thunder lock: enabled Nov 02 12:33:57.397313 n-d-857339-6 devstack@n-api.service[127754]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:33:57.397313 n-d-857339-6 devstack@n-api.service[127754]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:33:57.438612 n-d-857339-6 devstack@n-api.service[127754]: Python main interpreter initialized at 0x556bc46f09c0 Nov 02 12:33:57.438612 n-d-857339-6 devstack@n-api.service[127754]: python threads support enabled Nov 02 12:33:57.438612 n-d-857339-6 devstack@n-api.service[127754]: your server socket listen backlog is limited to 100 connections Nov 02 12:33:57.438612 n-d-857339-6 devstack@n-api.service[127754]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:33:57.439046 n-d-857339-6 devstack@n-api.service[127754]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:33:57.439046 n-d-857339-6 devstack@n-api.service[127754]: *** Operational MODE: preforking *** Nov 02 12:33:57.439355 n-d-857339-6 devstack@n-api.service[127754]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:33:57.439355 n-d-857339-6 devstack@n-api.service[127754]: spawned uWSGI master process (pid: 127754) Nov 02 12:33:57.439610 n-d-857339-6 systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:33:57.441747 n-d-857339-6 devstack@n-api.service[127754]: spawned uWSGI worker 1 (pid: 127766, cores: 1) Nov 02 12:33:57.441747 n-d-857339-6 devstack@n-api.service[127754]: spawned uWSGI worker 2 (pid: 127767, cores: 1) Nov 02 12:33:57.441747 n-d-857339-6 devstack@n-api.service[127754]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:33:58.116636 n-d-857339-6 devstack@n-api.service[127766]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:33:58.118646 n-d-857339-6 devstack@n-api.service[127767]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:33:59.371158 n-d-857339-6 devstack@n-api.service[127766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:33:59.371158 n-d-857339-6 devstack@n-api.service[127766]: from cryptography.utils import int_from_bytes Nov 02 12:33:59.371826 n-d-857339-6 devstack@n-api.service[127767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:33:59.371826 n-d-857339-6 devstack@n-api.service[127767]: from cryptography.utils import int_from_bytes Nov 02 12:33:59.372269 n-d-857339-6 devstack@n-api.service[127766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:33:59.372269 n-d-857339-6 devstack@n-api.service[127766]: from cryptography.utils import int_from_bytes Nov 02 12:33:59.372762 n-d-857339-6 devstack@n-api.service[127767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:33:59.372762 n-d-857339-6 devstack@n-api.service[127767]: from cryptography.utils import int_from_bytes Nov 02 12:34:01.864734 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:34:01.865407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:34:01.865551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:34:01.865933 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:34:01.866192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:34:01.866593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.866918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.867246 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.867568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.867900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.868217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.868574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.868905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.869263 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.869499 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.869821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.870156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857339-6 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.870482 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.870797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.871114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.871437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.871749 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.872079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.872387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.872945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.873395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.873708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.874026 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.874652 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.874769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.874995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.875323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.875657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.875976 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.876291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.876811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:34:01.877826 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857339-6 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.877927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:34:01.878010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.878010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.878147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:34:01.878314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.878546 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:34:01.878698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.878800 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:34:01.879037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879194 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879642 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.879960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.880975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881204 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.881951 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882210 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-857339-6 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.882891 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883176 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883489 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883757 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.883964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.884978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885482 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885809 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.885976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886542 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.886846 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887207 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887778 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.887988 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888624 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.888951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-857339-6 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.889918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890779 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.890909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891491 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.891940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.892149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.892299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.892567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.892745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.893472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.893629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.893769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894017 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.894973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895479 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.895898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896401 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896821 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.896929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.897982 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898317 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.898954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.899089 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.899267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.899373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.899845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.899963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.900155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.900256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.900469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.909794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.909794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910259 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.910984 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.911917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912260 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912609 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.912871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913333 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913624 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913803 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.913978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914077 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914895 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.914979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915348 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.915975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916749 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.916900 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917325 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917586 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.917856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.917997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.918130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.918270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.918362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.918459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.918554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.918655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.918744 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.918838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.918926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.919011 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.919200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919343 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.919434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.919630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.919892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.919986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.920120 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.920217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.920312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.920398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.920516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.920625 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.920715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.920800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.920892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.920985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.921175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.921356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921449 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.921543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.921724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.921897 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.921981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.922074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.922166 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.922309 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.922400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.922486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.922579 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.922713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.922860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.922953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.923094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.923228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.923360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.923450 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.923545 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.923641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.923736 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.923823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.923908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.924001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.924149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.924250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.924400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.924558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.924697 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.924881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.924979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.925064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.925137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.925283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.925382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.925469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.925555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:34:01.925699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.925699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.925926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926872 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.926973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927146 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927244 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927645 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927645 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.927974 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928070 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.928943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929233 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.929908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.930862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.931875 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932778 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.932933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.933816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.934794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.935985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.936981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.937943 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.938940 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.939036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.939253 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.939347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.940098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.940215 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.940446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.940578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944592 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944694 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.944912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945017 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945192 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945570 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.945912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946814 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.946997 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.947946 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948031 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948398 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.948859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949110 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949807 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.949977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.950986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.951941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952265 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.952985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.953947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954681 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.954898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.955001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.955229 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.955373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956428 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.956867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957734 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.957835 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.958050 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.958159 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.958369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.958489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.959766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.959893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.959999 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960579 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.960994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.961978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.962994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963507 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963604 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.963902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.964869 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965187 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965516 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.965842 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.966832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967476 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.967798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968755 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.968985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969078 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969625 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.969952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.970939 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.971115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.971298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.971612 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.971716 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.971937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972380 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972668 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.972992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973314 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973648 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973744 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.973969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974592 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.974906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.975957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.976171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.976271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.976518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.976615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.976831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977777 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.977872 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.978890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.979828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.980801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981434 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.981956 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982362 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982680 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.982906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983018 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983314 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.983927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984808 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.984917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985121 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.985920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986404 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986747 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.986854 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987504 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.987886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988711 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.988854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989039 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.989963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.990931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.991931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.992942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993158 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993471 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993573 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.993890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994211 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994428 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994559 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.994853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995374 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.995912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996638 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.996948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997080 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.997900 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998664 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.998876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999018 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:01.999964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000170 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.000930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001233 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001792 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.001896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.002131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.002721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.002943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003430 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003887 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.003981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.004949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005471 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.005884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006089 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.006858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.007975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.008066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.008297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.008400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.008644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.008751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009201 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.009925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.010970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011508 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.011921 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.012878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013195 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013554 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.013833 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014487 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.014810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015017 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.015916 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.016960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.017934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018353 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.018888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019077 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.019923 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.020137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.020241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.020967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.021925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.022019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.022241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.022355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.022604 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.022931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023034 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.023984 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.024212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.024306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.024814 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.024966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025550 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.025925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026547 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.026888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027259 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027434 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.027852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028167 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028730 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.028834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029681 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.029998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030641 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.030959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031059 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031280 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.031917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.032890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.033863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034092 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034734 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.034827 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.035067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.035390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.035508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.035714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.035817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.036877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037133 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037364 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.037821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038109 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038514 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.038855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.039444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.039602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.039602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.039842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.039955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.040953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041268 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.041999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.042220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.042373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.042593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.042695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.042904 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043238 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043338 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.043883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044563 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.044896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.045081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.045298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.045441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.045710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.045809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.046824 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047058 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.047828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048144 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.048827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.049589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.049698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.049908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.050276 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.050724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.051063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.051301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.051403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.051711 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.052050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.052272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.052375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.052661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.052758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.053981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.054945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.055141 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.055266 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.055583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.055683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.055925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.056036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.056236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.056569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.056909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.057232 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.057338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.057568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.057664 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.057903 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.058975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.059994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.060271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.060422 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.060672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.060996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.061361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.061603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.061824 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.061958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.062452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.062830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.062942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.063911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.064015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.064243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.064332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.064622 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.065302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.065493 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.065626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.065826 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066259 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.066892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.067133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.067235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.067474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.067715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068058 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068737 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.068871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069157 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.069821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070679 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.070999 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071127 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071434 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071662 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.071981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.072098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.072445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.072637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.072743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.072837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.073831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074368 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074605 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.074933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075262 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.075906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076227 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076316 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.076904 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077507 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.077981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078266 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078582 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.078951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.079892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.080121 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.080213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.080475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.080718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.080996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.081120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.081394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.081545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.081744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.081839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082434 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082710 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.082931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083092 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.083908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.084987 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.085934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.086164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.086264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.086482 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.086575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.086809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.087840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088404 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088779 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.088886 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089097 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089192 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089430 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.089837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090061 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.090943 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091295 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091397 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.091932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.092903 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093240 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.093971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094499 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.094913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095754 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.095895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.096105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.096236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.096415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.096676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.096782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.097806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098174 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.098990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.099945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.100037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.100266 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.100371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.100608 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.100933 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.101289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.102716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.102818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.102906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.102906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103539 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.103801 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.104049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.104217 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.104432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.104596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.104829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105182 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105479 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105708 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.105809 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.106766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107418 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.107969 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.108956 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.109920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110882 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.110983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.111220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.111315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.111557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.112230 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.112380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.112768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.112911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.113101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.113220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.113494 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.113702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.113811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114480 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.114939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.115802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116364 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116710 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.116831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.117988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.118949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119042 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119590 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119685 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.119910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120605 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.120930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.121999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122622 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.122997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.123967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.124873 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125502 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.125841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126476 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126608 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.126949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.127139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.127988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.128207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.128331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.128417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.128741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.128865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129374 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.129853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.130888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131204 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.131942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132047 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.132952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133121 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.133961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.134980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.135924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.136893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.137981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.138906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139435 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139754 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.139846 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.140835 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141157 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.141806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142694 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.142822 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.143850 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144710 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.144804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.145030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.145174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.145350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.145444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.145614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:34:02.145706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.146015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.146332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.146668 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.146995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.147334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.147662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.147982 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.148323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.148667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.148988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.149308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.149887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.150205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.150531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.150850 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.151169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.151494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.151825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.152164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.152510 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.152842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.153182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.153518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.153878 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.154201 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.154583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.154926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.155251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.155571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.155885 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:34:02.156221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:34:02.209143 n-d-857339-6 devstack@n-api.service[127767]: INFO dbcounter [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Registered counter for database nova_api Nov 02 12:34:02.219275 n-d-857339-6 devstack@n-api.service[127766]: INFO dbcounter [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Registered counter for database nova_api Nov 02 12:34:02.233489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_db.sqlalchemy.engines [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.241036 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_db.sqlalchemy.engines [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.241678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writer thread running {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.248704 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writer thread running {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.302798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.context [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=127767) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:34:02.307687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.308284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.310071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.310288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.context [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=127766) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:34:02.311489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.311943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.314057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.314411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.315452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.316970 n-d-857339-6 devstack@n-api.service[127767]: INFO dbcounter [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Registered counter for database nova_cell0 Nov 02 12:34:02.317370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.317957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.318425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.320519 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.321919 n-d-857339-6 devstack@n-api.service[127767]: INFO dbcounter [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Registered counter for database nova_cell1 Nov 02 12:34:02.322785 n-d-857339-6 devstack@n-api.service[127766]: INFO dbcounter [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Registered counter for database nova_cell0 Nov 02 12:34:02.327076 n-d-857339-6 devstack@n-api.service[127766]: INFO dbcounter [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Registered counter for database nova_cell1 Nov 02 12:34:02.329748 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_db.sqlalchemy.engines [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.332127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_db.sqlalchemy.engines [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.334971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_db.sqlalchemy.engines [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.337111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_db.sqlalchemy.engines [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.339629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writer thread running {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.345310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writer thread running {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.345659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writer thread running {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.485073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writer thread running {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.495600 n-d-857339-6 devstack@n-api.service[127766]: INFO dbcounter [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Registered counter for database nova_cell0 Nov 02 12:34:02.496599 n-d-857339-6 devstack@n-api.service[127767]: INFO dbcounter [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Registered counter for database nova_cell0 Nov 02 12:34:02.503483 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_db.sqlalchemy.engines [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.505714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_db.sqlalchemy.engines [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Nov 02 12:34:02.508787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writer thread running {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.515136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writer thread running {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:34:02.835576 n-d-857339-6 devstack@n-api.service[127766]: WARNING keystonemiddleware.auth_token [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:34:02.843199 n-d-857339-6 devstack@n-api.service[127766]: WARNING keystonemiddleware.auth_token [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:34:02.845019 n-d-857339-6 devstack@n-api.service[127767]: WARNING keystonemiddleware.auth_token [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:34:02.852563 n-d-857339-6 devstack@n-api.service[127767]: WARNING keystonemiddleware.auth_token [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:34:03.193055 n-d-857339-6 devstack@n-api.service[127766]: WARNING keystonemiddleware.auth_token [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:34:03.199117 n-d-857339-6 devstack@n-api.service[127766]: WARNING keystonemiddleware.auth_token [None req-1d138520-55e9-4bcd-944e-cf27dbae8ba7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:34:03.204539 n-d-857339-6 devstack@n-api.service[127766]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bc46f09c0 pid: 127766 (default app) Nov 02 12:34:03.209500 n-d-857339-6 devstack@n-api.service[127767]: WARNING keystonemiddleware.auth_token [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:34:03.215513 n-d-857339-6 devstack@n-api.service[127767]: WARNING keystonemiddleware.auth_token [None req-ab426087-e325-4ee6-9cf7-eee2a674889a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:34:03.221448 n-d-857339-6 devstack@n-api.service[127767]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bc46f09c0 pid: 127767 (default app) Nov 02 12:34:47.323991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.325820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.327357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.328096 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.863751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.864476 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.865344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:47.866027 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:48.737326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '.version_select at 0x7eff5dfff940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:48.744235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=127766) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 12:34:48.745092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.745660 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.746158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.783525 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.784014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.784452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.799980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.800456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.800913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.807555 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7e3b0d93-7759-4a3e-9968-064540e1f102 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.493986 Nov 02 12:34:48.816530 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1/1] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:34:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:48.977998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:48.979585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.980070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.980518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.981405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.981855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.982272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.022627 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3492b083-226b-4a57-bbf9-a10b45af79de tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] 10.222.0.64 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.213227 Nov 02 12:34:49.023142 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1164 bytes} [Wed Nov 2 12:34:48 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:34:49.045411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5df75f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.049988 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.050481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.050924 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.051654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.052106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.052549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.095831 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6e7428cf-662b-4209-b615-23924f1e3c98 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 1.242182 Nov 02 12:34:49.096441 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1/3] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:34:47 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.134775 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.136570 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.137068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.137509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.138259 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.138712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.139135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.162939 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-168340e6-bdfe-4f75-9ae3-f882fef4ae92 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138744 Nov 02 12:34:49.163497 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1176 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.205540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2c5d6e8c-bdce-48ef-842d-a126a3c46cf3 tempest-AZAdminNegativeTestJSON-325175804 tempest-AZAdminNegativeTestJSON-325175804-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.207104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2c5d6e8c-bdce-48ef-842d-a126a3c46cf3 tempest-AZAdminNegativeTestJSON-325175804 tempest-AZAdminNegativeTestJSON-325175804-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f11725e56de34281bb4c5cf6fdd34217', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29917aa964c94f018bdc7cc587f35032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2c5d6e8c-bdce-48ef-842d-a126a3c46cf3 tempest-AZAdminNegativeTestJSON-325175804 tempest-AZAdminNegativeTestJSON-325175804-project] Request method failure captured: Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPkrLeuHy1jdFuvU5RRTdxuDeNWXnLNnmAYPah6brLqf4aSmFKO1Fe5wLbXrgN61eRj_mCQZ3oX0Sm19-2C3hSL-g2mMCpcFfJ0kg4pTg4vZsW4xsV4vi6El1cKOlP0efCU1cj6rfUPmsF6P7UtwthvR4oy1AF1gRyyqJ4qZK1QnVg Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 29917aa964c94f018bdc7cc587f35032 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AZAdminNegativeTestJSON-325175804 Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:34:49.210619 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_29917aa964c94f018bdc7cc587f35032", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29917aa964c94f018bdc7cc587f35032"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/29917aa964c94f018bdc7cc587f35032"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/29917aa964c94f018bdc7cc587f35032"}]}] Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AZAdminNegativeTestJSON-325175804 Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 29917aa964c94f018bdc7cc587f35032 Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-325175804 Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AZAdminNegativeTestJSON-325175804-project Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: f11725e56de34281bb4c5cf6fdd34217 Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AZAdminNegativeTestJSON-325175804-project Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:34:49.211630 n-d-857339-6 devstack@n-api.service[127767]: action_args: {} Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:49.212186 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:49.213742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2c5d6e8c-bdce-48ef-842d-a126a3c46cf3 tempest-AZAdminNegativeTestJSON-325175804 tempest-AZAdminNegativeTestJSON-325175804-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:49.214544 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2c5d6e8c-bdce-48ef-842d-a126a3c46cf3 tempest-AZAdminNegativeTestJSON-325175804 tempest-AZAdminNegativeTestJSON-325175804-project] 10.222.0.64 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.114574 Nov 02 12:34:49.214544 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 2/5] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 116 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:49.216954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d6a84cd-253a-4f2d-92ba-412d298bbcae tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-20042298", "name": "tempest-test_aggregate-192676109"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:49.253641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-0d6a84cd-253a-4f2d-92ba-412d298bbcae tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid 89d3cacd-3b07-4cec-a79d-71846c338090 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:34:49.278399 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Calling method '.version_select at 0x7eff5ddeee50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.282293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.282789 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.283222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.301405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.302281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.302605 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.314358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.314757 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.315195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.321878 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.157386 Nov 02 12:34:49.322456 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 4/6] 10.222.0.64 () {60 vars in 1208 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:49.323441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.324346 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a9099c3d-ec3f-41ad-8bee-a5c52e7579b2 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001121 Nov 02 12:34:49.326817 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 5/7] 10.222.0.64 () {56 vars in 886 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:34:49.425348 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d6a84cd-253a-4f2d-92ba-412d298bbcae tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 219 microversion: 2.1 time: 0.211693 Nov 02 12:34:49.425944 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 3/8] 10.222.0.64 () {60 vars in 1165 bytes} [Wed Nov 2 12:34:49 2022] POST /compute/v2.1/os-aggregates => generated 219 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.430653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.432469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.433358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.433799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.434539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.435001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.435543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.463297 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8b0681f3-4f9b-4411-9d93-e6ffd09a9cd5 tempest-AZAdminV2TestJSON-1811847736 tempest-AZAdminV2TestJSON-1811847736-project-admin] 10.222.0.64 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.036078 Nov 02 12:34:49.463894 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 4/9] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.468112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5dd8c430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.471713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.478570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.478570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.478570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.478570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.478911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.499439 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b4adbb38-4321-46ed-b9f7-b26c9e80b1fc tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.034513 Nov 02 12:34:49.500029 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.504818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-922f7054-d562-49c0-83b4-ed0150df78b4 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.517811 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-922f7054-d562-49c0-83b4-ed0150df78b4 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016727 Nov 02 12:34:49.522179 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:49.522892 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5d529f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.526590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.527007 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.528049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.528301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.528663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.529095 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.553697 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d405f307-903d-473d-89e7-49f44e443183 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.034291 Nov 02 12:34:49.556753 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 7/12] 10.222.0.64 () {58 vars in 1145 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:34:49.558763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-864b0528-2036-4fcc-bc1e-9cee78bb246e tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:49.576295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-864b0528-2036-4fcc-bc1e-9cee78bb246e tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.576861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-864b0528-2036-4fcc-bc1e-9cee78bb246e tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.577300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-864b0528-2036-4fcc-bc1e-9cee78bb246e tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.979082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1004130899", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:50.665988 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-864b0528-2036-4fcc-bc1e-9cee78bb246e tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 310 microversion: 2.1 time: 1.110435 Nov 02 12:34:50.667441 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 8/13] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:34:49 2022] POST /compute/v2.1/os-aggregates/1/action => generated 310 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:50.739328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:34:50.877219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-953412733", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "availability_zone": "tempest-test_az-20042298"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:50.924146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.924667 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.931544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.931544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.931544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.931544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.160527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:34:51.160981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:34:51.161463 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:34:51.161811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:34:51.162283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:34:51.181321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.184670 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.185468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.186376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.187502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.188161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.201192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:34:51.229895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Getting quotas for project 8ea3b8ac6b104721ba07c7b85bbb64aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:51.237471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Getting quotas for user 936480fc35244d79a3ec7157060a1dbc and project 8ea3b8ac6b104721ba07c7b85bbb64aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:51.249712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:34:51.252647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:34:51.391278 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-321f30f1-fe85-4a83-bb8b-e15b9d2d0c69 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063630 Nov 02 12:34:51.392235 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 6/14] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:34:51.405393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-72ac1042-d5cd-47f2-a11f-365a28b7186d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.406161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-72ac1042-d5cd-47f2-a11f-365a28b7186d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.419466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:34:51.420056 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:34:51.420761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:34:51.421397 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:34:51.421934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:34:51.443639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.444470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.445223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.446226 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.446856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.447525 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.504836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Getting quotas for project 1dbe11c2ed6c436caf0eb7c8da9beed5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:51.537478 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Getting quotas for user f441720944f34d6dad78783005fa6165 and project 1dbe11c2ed6c436caf0eb7c8da9beed5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:51.552091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-72ac1042-d5cd-47f2-a11f-365a28b7186d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.559365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:34:51.564340 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:34:51.574244 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-72ac1042-d5cd-47f2-a11f-365a28b7186d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1220 microversion: 2.1 time: 0.172901 Nov 02 12:34:51.574969 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1220 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:51.703299 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e21f724b-67fd-4bb8-a821-be29ae30bd25 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893804 Nov 02 12:34:51.704524 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 9/16] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:34:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:34:51.715997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5bdfea31-ee1a-413c-9496-573ef6d15022 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.716648 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5bdfea31-ee1a-413c-9496-573ef6d15022 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.772142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5bdfea31-ee1a-413c-9496-573ef6d15022 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.779804 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5bdfea31-ee1a-413c-9496-573ef6d15022 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1240 microversion: 2.1 time: 0.067733 Nov 02 12:34:51.780514 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 8/17] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:52.620178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-19dcaa89-53f0-4f12-95df-01b6a75ba609 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.620843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-19dcaa89-53f0-4f12-95df-01b6a75ba609 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.710470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-19dcaa89-53f0-4f12-95df-01b6a75ba609 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.726064 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-19dcaa89-53f0-4f12-95df-01b6a75ba609 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1220 microversion: 2.1 time: 0.112170 Nov 02 12:34:52.726907 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 10/18] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:52.803351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ac91fef-e021-42d5-9ec8-3a02677ef867 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.804111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3ac91fef-e021-42d5-9ec8-3a02677ef867 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.934106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3ac91fef-e021-42d5-9ec8-3a02677ef867 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.955173 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3ac91fef-e021-42d5-9ec8-3a02677ef867 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1240 microversion: 2.1 time: 0.153270 Nov 02 12:34:52.973704 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 9/19] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1240 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:53.752405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-446252a4-7c9f-482f-b0e4-1b24306a525d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:53.754122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-446252a4-7c9f-482f-b0e4-1b24306a525d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:53.950710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-446252a4-7c9f-482f-b0e4-1b24306a525d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.961489 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-446252a4-7c9f-482f-b0e4-1b24306a525d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1220 microversion: 2.1 time: 0.214228 Nov 02 12:34:53.965891 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 11/20] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:53 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:53.995098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:53.996659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.010030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.010529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.011082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.011807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.012261 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.012781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.185266 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.200053 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ff997d97-38b3-4aa6-ae94-ab43861c52fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1240 microversion: 2.1 time: 0.208615 Nov 02 12:34:54.201232 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 10/21] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:53 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1240 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:54.983456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.984118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.992029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.992029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.992305 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.993009 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.993749 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.994186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.151340 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.164737 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37886756-a40d-4501-b249-ba71c7a20d80 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1236 microversion: 2.1 time: 0.185200 Nov 02 12:34:55.165322 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 12/22] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1236 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:55.224164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.224915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.231870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.232382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.232851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.233567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.234027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.234459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.329302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.343986 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-267d08f1-cf81-4ca7-b929-5fba7eac1e3c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1288 microversion: 2.1 time: 0.123523 Nov 02 12:34:55.345041 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:56.188619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.189401 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.196434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.197399 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.198298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.200667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.200667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.200667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.272707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.296598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-55f13a49-b1e3-41f6-8e8f-849f63e722bc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1292 microversion: 2.1 time: 0.098372 Nov 02 12:34:56.296999 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:56.556682 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2cced33d-f65a-4e35-9a38-50e19a1b0346 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Action: 'create', calling method: .version_select at 0x7eff5d43de50>, body: {"keypair": {"name": "tempest-keypair-1300920194", "type": "ssh", "user_id": "832102ac300e41f696c8a0eb247148df", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvFrR7wlEjf1saeqbepvAyGs9xJK4+ecm39WYBjsABWFTGhdZCjS8VFO6hJncYYi7wYgqYGRYKm/3kRCkpbBk7N9uXf3LXUXeJg8W8QBA9ilR8CT6rCAt6jsLAuzKKwQg=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:56.571243 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-da0fb58d-9679-40bc-ae53-f957e6f52ad3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-737843424", "ram": 512, "vcpus": 1, "disk": 10, "id": 420658425, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:56.609794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2cced33d-f65a-4e35-9a38-50e19a1b0346 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:56.615674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2cced33d-f65a-4e35-9a38-50e19a1b0346 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for user f741fa54a8974024a900a62183f464dd and project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:56.768425 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-da0fb58d-9679-40bc-ae53-f957e6f52ad3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.470531 Nov 02 12:34:56.769064 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 13/25] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:34:56 2022] POST /compute/v2.1/flavors => generated 412 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:56.773843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.774454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.780932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.781429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.781926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.782633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.783097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.783525 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.821583 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2cced33d-f65a-4e35-9a38-50e19a1b0346 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.714901 Nov 02 12:34:56.822468 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 13/26] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:34:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 717 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:34:56.869535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.878007 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4f73a0d7-6a57-4d48-a10e-2a84d9fd0ae1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1294 microversion: 2.1 time: 0.107926 Nov 02 12:34:56.878816 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:56.885533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Calling method '.version_select at 0x7eff5d3e4a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.893403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=127767) load_cells /opt/stack/nova/nova/compute/api.py:319}} Nov 02 12:34:56.894322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.894964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.895582 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.913433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.913938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.914384 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.926517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.927088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.927533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.934398 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b7539b29-901d-4fd7-bb8a-21222f72bf16 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.110497 Nov 02 12:34:56.935387 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 14/28] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:56.940269 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7278164d-8918-4048-b03d-21894db505c0 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Action: 'create', calling method: .version_select at 0x7eff5d36fe50>, body: {"keypair": {"name": "tempest-keypair-60376854", "type": "ssh", "user_id": "832102ac300e41f696c8a0eb247148df", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNK7LufwZ4JYO9f4wPV0rsJ1tFlGJyfUoNPmCWMxDd5Zqd8Py5/u5wyeMmgl5xjeYHc+0WrSs6cl1GhRPu4/fnzdmNE4LdKOQA096AU+JVattoom2EigOeIhYjP6chErFA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:56.957511 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-7278164d-8918-4048-b03d-21894db505c0 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:56.962112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-7278164d-8918-4048-b03d-21894db505c0 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for user f741fa54a8974024a900a62183f464dd and project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:57.032991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d1aa4c24-9935-4fa9-a2c3-334e1beb8280 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.042252 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-d1aa4c24-9935-4fa9-a2c3-334e1beb8280 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] HTTP exception thrown: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d1aa4c24-9935-4fa9-a2c3-334e1beb8280 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Request method failure captured: Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPuIMODJr8zX2CSdDdWPRuprmz_krFTCZ3ALszmOmNmxeJihVzlJ8IZAXuGvP3TybcAfq5KZs0VgzYWvnOjyk9oSUnrc348TYToo9gqbGgjDH4xApEc6uFtQKqjzJS4zJYYrAaFyluyAaJpkHdayAMI9J-nZaGl5rdRmC_I9PwtpLw Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:34:57.044695 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5656b56935ed484c89e4d47df05ee1f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}] Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 366b248ffa41498d82f096d21646afaf Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:34:57.046095 n-d-857339-6 devstack@n-api.service[127766]: exception: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'flavor_id': '420658425', 'id': 'hw:cpu_thread_policy'} Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.046816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d1aa4c24-9935-4fa9-a2c3-334e1beb8280 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Returning 404 to user: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d1aa4c24-9935-4fa9-a2c3-334e1beb8280 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] 10.222.0.64 "GET /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.166240 Nov 02 12:34:57.047927 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.063117 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7278164d-8918-4048-b03d-21894db505c0 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.126411 Nov 02 12:34:57.068630 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 15/30] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:34:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:34:57.068741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9e264db0-964b-4996-8e38-a5ba927f2df3 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.072802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9e264db0-964b-4996-8e38-a5ba927f2df3 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '366b248ffa41498d82f096d21646afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5656b56935ed484c89e4d47df05ee1f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9e264db0-964b-4996-8e38-a5ba927f2df3 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Request method failure captured: Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/flavors/420658425/os-extra_specs HTTP/1.1 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 66 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPuIMODJr8zX2CSdDdWPRuprmz_krFTCZ3ALszmOmNmxeJihVzlJ8IZAXuGvP3TybcAfq5KZs0VgzYWvnOjyk9oSUnrc348TYToo9gqbGgjDH4xApEc6uFtQKqjzJS4zJYYrAaFyluyAaJpkHdayAMI9J-nZaGl5rdRmC_I9PwtpLw Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:34:57.075053 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5656b56935ed484c89e4d47df05ee1f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}] Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 366b248ffa41498d82f096d21646afaf Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Nov 02 12:34:57.076072 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'flavor_id': '420658425', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:57.076710 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Nov 02 12:34:57.077971 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.080336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9e264db0-964b-4996-8e38-a5ba927f2df3 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.080336 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9e264db0-964b-4996-8e38-a5ba927f2df3 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] 10.222.0.64 "POST /compute/v2.1/flavors/420658425/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.011671 Nov 02 12:34:57.082041 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 16/31] 10.222.0.64 () {60 vars in 1221 bytes} [Wed Nov 2 12:34:57 2022] POST /compute/v2.1/flavors/420658425/os-extra_specs => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.088733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fa5d01d9-6402-4e9a-a032-72412a6b9545 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Calling method '.version_select at 0x7eff5dd73f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.101225 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fa5d01d9-6402-4e9a-a032-72412a6b9545 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "GET /compute/v2.1/os-keypairs/tempest-keypair-1300920194?user_id=832102ac300e41f696c8a0eb247148df" status: 200 len: 512 microversion: 2.10 time: 0.017870 Nov 02 12:34:57.109018 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 17/32] 10.222.0.64 () {60 vars in 1340 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1300920194?user_id=832102ac300e41f696c8a0eb247148df => generated 512 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:34:57.117492 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b13b2b98-c437-4201-b552-cbab5c9a32ef tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.124262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:57.186544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb512251-50ec-49ff-9220-009cbaba6844 tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Calling method '.version_select at 0x7eff5d449670>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.189052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fb512251-50ec-49ff-9220-009cbaba6844 tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '3c5f8426ba7344469298957041768b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89092c4e6c448a598f74969c8d10549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb512251-50ec-49ff-9220-009cbaba6844 tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Request method failure captured: Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hypervisors/n-h2-857339-6/search HTTP/1.1 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPvhM-WZQOUD5_r45DFcPvNsK_PC8myFtHRrMwMA4Y6ddSrsVVLr2trYmK8r1A-xNRihM1vXm2fKT5cr_2HlVQm1JRZx4NXFvTajYOd9QSILK18EKC67xDwQ_r5WJputFepwH9LAOSq1qtU9j7kGOz2MF4skH8C3_HG6yG0067aVyU Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: c89092c4e6c448a598f74969c8d10549 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:34:57.193284 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c89092c4e6c448a598f74969c8d10549", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c89092c4e6c448a598f74969c8d10549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c89092c4e6c448a598f74969c8d10549"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c89092c4e6c448a598f74969c8d10549"}]}] Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: c89092c4e6c448a598f74969c8d10549 Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-174618751-project Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 3c5f8426ba7344469298957041768b61 Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751-project Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:34:57.200217 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-h2-857339-6'} Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:57.200888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Nov 02 12:34:57.201771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.203771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb512251-50ec-49ff-9220-009cbaba6844 tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.203771 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb512251-50ec-49ff-9220-009cbaba6844 tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/n-h2-857339-6/search" status: 403 len: 117 microversion: 2.1 time: 0.146677 Nov 02 12:34:57.203771 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-hypervisors/n-h2-857339-6/search => generated 117 bytes in 148 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.203771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3abcd129-64a0-4f99-a51c-a58803a00a09 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Action: 'create', calling method: .version_select at 0x7eff5d3bd430>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1324751914", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3XkAboi81OVIEL8z0z0MESde470TFRbCiWzjbE0D8gTe2U4k9VnroIizdihdWXgcw+9Kqr+suVJivh5LC/gNhQ1Y9WhIXGZ8H3egmgadE0QmTG8nmIBXyYOtRIu1fy7w=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.227007 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-3abcd129-64a0-4f99-a51c-a58803a00a09 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:57.231626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-3abcd129-64a0-4f99-a51c-a58803a00a09 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Getting quotas for user f741fa54a8974024a900a62183f464dd and project d2562cc4e6064bf5b72ab6628817196a. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:57.282605 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b13b2b98-c437-4201-b552-cbab5c9a32ef tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/420658425/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.171289 Nov 02 12:34:57.283611 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 18/34] 10.222.0.64 () {60 vars in 1221 bytes} [Wed Nov 2 12:34:57 2022] POST /compute/v2.1/flavors/420658425/os-extra_specs => generated 66 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:34:57.288900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Calling method '.version_select at 0x7eff5d394310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.291935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.293038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.293512 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.309036 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Request method failure captured: Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPww9QGA0urKNoNIgyv5oN2cIWCUXszfgz_ATW7TVFRepoSsmnFpVyoiCPp95_20lkUrCCZUX_ShP_QONzTpZrnyS3h2dWIlHCdnVDYJWNAb9Ray90UNfabiY3ua9rfDTwdvOt07lJprZWGicmZs-HhdArFYAn6S8p-Ato_jeUc_m8 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cda588c0e56a42879ef38cde96538a62 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:34:57.310530 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cda588c0e56a42879ef38cde96538a62", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cda588c0e56a42879ef38cde96538a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cda588c0e56a42879ef38cde96538a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cda588c0e56a42879ef38cde96538a62"}]}] Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cda588c0e56a42879ef38cde96538a62 Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: faf696a1010f4a9d8ea15ca6929bc714 Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:34:57.311582 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'nonexistent_hypervisor_name'} Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.312168 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.313189 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20f67c2e-a2d1-49f1-b31b-dd313ad688d3 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.027378 Nov 02 12:34:57.313537 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 19/35] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.318326 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7949956-c5e7-4a83-8164-13811ea4ef7b tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.320000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a7949956-c5e7-4a83-8164-13811ea4ef7b tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '366b248ffa41498d82f096d21646afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5656b56935ed484c89e4d47df05ee1f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7949956-c5e7-4a83-8164-13811ea4ef7b tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Request method failure captured: Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPuIMODJr8zX2CSdDdWPRuprmz_krFTCZ3ALszmOmNmxeJihVzlJ8IZAXuGvP3TybcAfq5KZs0VgzYWvnOjyk9oSUnrc348TYToo9gqbGgjDH4xApEc6uFtQKqjzJS4zJYYrAaFyluyAaJpkHdayAMI9J-nZaGl5rdRmC_I9PwtpLw Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:34:57.321880 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5656b56935ed484c89e4d47df05ee1f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}] Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 366b248ffa41498d82f096d21646afaf Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:34:57.323054 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'flavor_id': '420658425', 'id': 'hw:numa_nodes'} Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:57.323582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.324901 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7949956-c5e7-4a83-8164-13811ea4ef7b tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.325950 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a7949956-c5e7-4a83-8164-13811ea4ef7b tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] 10.222.0.64 "DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009732 Nov 02 12:34:57.329411 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 20/36] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.338155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.338155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.346505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.347091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.347908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.348706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.349225 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.349709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.418838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.434069 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3abcd129-64a0-4f99-a51c-a58803a00a09 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.237435 Nov 02 12:34:57.434721 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 17/37] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:34:57 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 239 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:34:57.437439 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9a6aec70-73c1-4a36-b1bc-2bb01038660c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1298 microversion: 2.1 time: 0.106364 Nov 02 12:34:57.438389 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 21/38] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:57.444804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a5e4fcca-d471-43ad-b37a-62ee0b1eb6f7 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.457311 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Calling method '.version_select at 0x7eff5d3bde50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.459147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.470804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.472608 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.480692 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a5e4fcca-d471-43ad-b37a-62ee0b1eb6f7 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/420658425/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040519 Nov 02 12:34:57.481886 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 22/39] 10.222.0.64 () {60 vars in 1221 bytes} [Wed Nov 2 12:34:57 2022] POST /compute/v2.1/flavors/420658425/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:34:57.488250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ecd4eadb-2dc5-4acf-9f25-d3537c7f70d5 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Calling method '.version_select at 0x7eff5d288040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.492855 n-d-857339-6 devstack@n-api.service[127767]: WARNING oslo_db.sqlalchemy.utils [None req-ecd4eadb-2dc5-4acf-9f25-d3537c7f70d5 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:34:57.502966 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ecd4eadb-2dc5-4acf-9f25-d3537c7f70d5 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "GET /compute/v2.1/os-keypairs?user_id=832102ac300e41f696c8a0eb247148df" status: 200 len: 724 microversion: 2.10 time: 0.019458 Nov 02 12:34:57.503864 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 23/40] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-keypairs?user_id=832102ac300e41f696c8a0eb247148df => generated 724 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:34:57.510382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.510382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.510382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.522598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86992a05-9d9d-48b3-bd4c-cc39a6efdc50 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.527287 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-86992a05-9d9d-48b3-bd4c-cc39a6efdc50 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '366b248ffa41498d82f096d21646afaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5656b56935ed484c89e4d47df05ee1f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86992a05-9d9d-48b3-bd4c-cc39a6efdc50 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Request method failure captured: Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: request: PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 22 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPuIMODJr8zX2CSdDdWPRuprmz_krFTCZ3ALszmOmNmxeJihVzlJ8IZAXuGvP3TybcAfq5KZs0VgzYWvnOjyk9oSUnrc348TYToo9gqbGgjDH4xApEc6uFtQKqjzJS4zJYYrAaFyluyAaJpkHdayAMI9J-nZaGl5rdRmC_I9PwtpLw Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:34:57.529898 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5656b56935ed484c89e4d47df05ee1f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5656b56935ed484c89e4d47df05ee1f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5656b56935ed484c89e4d47df05ee1f6"}]}] Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 5656b56935ed484c89e4d47df05ee1f6 Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 366b248ffa41498d82f096d21646afaf Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: {"hw:numa_nodes": "1"} Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:34:57.531002 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'flavor_id': '420658425', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:57.532149 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Nov 02 12:34:57.533582 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.535735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86992a05-9d9d-48b3-bd4c-cc39a6efdc50 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.536829 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-86992a05-9d9d-48b3-bd4c-cc39a6efdc50 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807 tempest-FlavorsExtraSpecsNegativeTestJSON-649688807-project] 10.222.0.64 "PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018231 Nov 02 12:34:57.537757 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 24/41] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:34:57 2022] PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.542884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad7de0f8-62c6-42a8-a428-45e809a97efb tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Calling method '.version_select at 0x7eff5d266c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.549404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.549978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.550425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.559120 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8b7ca05c-a7f5-457b-8c03-fd971aa88c00 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.123008 Nov 02 12:34:57.559741 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 18/42] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:57.569289 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2ffed722-adf8-4a9c-ba06-640f79479e50 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.611020 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-2ffed722-adf8-4a9c-ba06-640f79479e50 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] HTTP exception thrown: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2ffed722-adf8-4a9c-ba06-640f79479e50 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Request method failure captured: Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPwX_tV4JTwc7LcZa9YJLWH7_TuD_VDto_pI5iO8U3UEKMjZQIv4ObmGaNkbLOoZlC7VY7j2TxB-kkAn-yBGop-7fj4NztdOwobUs8TcGEuFFkaWRwxBaoxGb7zZdxK84VcyhjJ5vpgFwR8D6TTEp-sf7hyHA7JKNDwpMuXMkLs6IA Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:34:57.613423 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e17c7b90e8b34149875a504667221965", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e17c7b90e8b34149875a504667221965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}] Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 16ac6ff817504787bdf969ce40ed14c0 Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:34:57.614901 n-d-857339-6 devstack@n-api.service[127766]: exception: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'flavor_id': '420658425', 'id': 'hw:cpu_thread_policy'} Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.615836 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2ffed722-adf8-4a9c-ba06-640f79479e50 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Returning 404 to user: Flavor 420658425 has no extra specs with key hw:cpu_thread_policy. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2ffed722-adf8-4a9c-ba06-640f79479e50 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.054299 Nov 02 12:34:57.617371 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 19/43] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/flavors/420658425/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.625759 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-01e4ea42-aa80-4139-8823-a0977b2735fd tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Calling method '.version_select at 0x7eff5d326700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.632686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-01e4ea42-aa80-4139-8823-a0977b2735fd tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '3c5f8426ba7344469298957041768b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c89092c4e6c448a598f74969c8d10549', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-01e4ea42-aa80-4139-8823-a0977b2735fd tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Request method failure captured: Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPvhM-WZQOUD5_r45DFcPvNsK_PC8myFtHRrMwMA4Y6ddSrsVVLr2trYmK8r1A-xNRihM1vXm2fKT5cr_2HlVQm1JRZx4NXFvTajYOd9QSILK18EKC67xDwQ_r5WJputFepwH9LAOSq1qtU9j7kGOz2MF4skH8C3_HG6yG0067aVyU Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: c89092c4e6c448a598f74969c8d10549 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:34:57.634787 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c89092c4e6c448a598f74969c8d10549", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c89092c4e6c448a598f74969c8d10549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c89092c4e6c448a598f74969c8d10549"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c89092c4e6c448a598f74969c8d10549"}]}] Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: c89092c4e6c448a598f74969c8d10549 Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751 Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-174618751-project Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 3c5f8426ba7344469298957041768b61 Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-174618751-project Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:34:57.640119 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '1'} Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:34:57.641844 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Nov 02 12:34:57.642930 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.644303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-01e4ea42-aa80-4139-8823-a0977b2735fd tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.644303 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-01e4ea42-aa80-4139-8823-a0977b2735fd tempest-HypervisorAdminNegativeUnderV252Test-174618751 tempest-HypervisorAdminNegativeUnderV252Test-174618751-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019509 Nov 02 12:34:57.644303 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 20/44] 10.222.0.64 () {58 vars in 1176 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.644808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f45ea413-f02e-484d-8357-4ecb1c1b29ac tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.649048 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f45ea413-f02e-484d-8357-4ecb1c1b29ac tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] HTTP exception thrown: Request body and URI mismatch Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f45ea413-f02e-484d-8357-4ecb1c1b29ac tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Request method failure captured: Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 27 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPwX_tV4JTwc7LcZa9YJLWH7_TuD_VDto_pI5iO8U3UEKMjZQIv4ObmGaNkbLOoZlC7VY7j2TxB-kkAn-yBGop-7fj4NztdOwobUs8TcGEuFFkaWRwxBaoxGb7zZdxK84VcyhjJ5vpgFwR8D6TTEp-sf7hyHA7JKNDwpMuXMkLs6IA Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:34:57.650632 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e17c7b90e8b34149875a504667221965", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e17c7b90e8b34149875a504667221965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}] Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 16ac6ff817504787bdf969ce40ed14c0 Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: {"hw:cpu_policy": "shared"} Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:34:57.652055 n-d-857339-6 devstack@n-api.service[127766]: exception: Request body and URI mismatch Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'flavor_id': '420658425', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.657881 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f45ea413-f02e-484d-8357-4ecb1c1b29ac tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f45ea413-f02e-484d-8357-4ecb1c1b29ac tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014220 Nov 02 12:34:57.659354 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 21/45] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:34:57 2022] PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:34:57.659793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Calling method '.version_select at 0x7eff5d5119d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.661320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.661805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.662242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.672335 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ad7de0f8-62c6-42a8-a428-45e809a97efb tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1324751914" status: 204 len: 0 microversion: 2.10 time: 0.127776 Nov 02 12:34:57.672335 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 25/46] 10.222.0.64 () {60 vars in 1325 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1324751914 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:34:57.677810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-177af815-166b-4b7e-b481-f59dec07dfc3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.679249 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] HTTP exception thrown: No hypervisor matching '7aeb0724-9c61-4dfe-a0ea-c69813e01281' could be found. Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Request method failure captured: Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hypervisors/7aeb0724-9c61-4dfe-a0ea-c69813e01281/servers HTTP/1.1 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPww9QGA0urKNoNIgyv5oN2cIWCUXszfgz_ATW7TVFRepoSsmnFpVyoiCPp95_20lkUrCCZUX_ShP_QONzTpZrnyS3h2dWIlHCdnVDYJWNAb9Ray90UNfabiY3ua9rfDTwdvOt07lJprZWGicmZs-HhdArFYAn6S8p-Ato_jeUc_m8 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cda588c0e56a42879ef38cde96538a62 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:34:57.680646 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cda588c0e56a42879ef38cde96538a62", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cda588c0e56a42879ef38cde96538a62"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cda588c0e56a42879ef38cde96538a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cda588c0e56a42879ef38cde96538a62"}]}] Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cda588c0e56a42879ef38cde96538a62 Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359 Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: faf696a1010f4a9d8ea15ca6929bc714 Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: exception: No hypervisor matching '7aeb0724-9c61-4dfe-a0ea-c69813e01281' could be found. Nov 02 12:34:57.681910 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '7aeb0724-9c61-4dfe-a0ea-c69813e01281'} Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7aeb0724-9c61-4dfe-a0ea-c69813e01281' could be found. Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.682633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7aeb0724-9c61-4dfe-a0ea-c69813e01281' could be found. Nov 02 12:34:57.683985 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.685307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] Returning 404 to user: No hypervisor matching '7aeb0724-9c61-4dfe-a0ea-c69813e01281' could be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-177af815-166b-4b7e-b481-f59dec07dfc3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Request method failure captured: Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: request: PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes HTTP/1.1 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 49 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPwX_tV4JTwc7LcZa9YJLWH7_TuD_VDto_pI5iO8U3UEKMjZQIv4ObmGaNkbLOoZlC7VY7j2TxB-kkAn-yBGop-7fj4NztdOwobUs8TcGEuFFkaWRwxBaoxGb7zZdxK84VcyhjJ5vpgFwR8D6TTEp-sf7hyHA7JKNDwpMuXMkLs6IA Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:34:57.685436 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e17c7b90e8b34149875a504667221965", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e17c7b90e8b34149875a504667221965"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e17c7b90e8b34149875a504667221965"}]}] Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: e17c7b90e8b34149875a504667221965 Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 16ac6ff817504787bdf969ce40ed14c0 Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Nov 02 12:34:57.686945 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'flavor_id': '420658425', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': ['string', Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'number']}}, Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': 'object'} Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Nov 02 12:34:57.687616 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.688746 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-177af815-166b-4b7e-b481-f59dec07dfc3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-177af815-166b-4b7e-b481-f59dec07dfc3 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016268 Nov 02 12:34:57.689684 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 26/47] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:34:57 2022] PUT /compute/v2.1/flavors/420658425/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:34:57.692924 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66ee1337-d14f-4659-9b4e-c5ea225cc1d6 tempest-HypervisorAdminNegativeUnderV252Test-997845359 tempest-HypervisorAdminNegativeUnderV252Test-997845359-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/7aeb0724-9c61-4dfe-a0ea-c69813e01281/servers" status: 404 len: 123 microversion: 2.1 time: 0.039191 Nov 02 12:34:57.694228 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1281 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/os-hypervisors/7aeb0724-9c61-4dfe-a0ea-c69813e01281/servers => generated 123 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:57.699422 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e19b8cbb-378a-4514-b17e-e924c372326a tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Calling method '.version_select at 0x7eff5d2f9f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.712284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-793e422d-704a-45a2-a3e0-b770155e9e70 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.801489 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e19b8cbb-378a-4514-b17e-e924c372326a tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60376854?user_id=832102ac300e41f696c8a0eb247148df" status: 204 len: 0 microversion: 2.10 time: 0.111428 Nov 02 12:34:57.803768 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 27/49] 10.222.0.64 () {60 vars in 1337 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60376854?user_id=832102ac300e41f696c8a0eb247148df => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:34:57.818763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-23aec179-0407-4932-b584-6a6356b9c715 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] Calling method '.version_select at 0x7eff5d272e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.923658 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-793e422d-704a-45a2-a3e0-b770155e9e70 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/420658425" status: 202 len: 0 microversion: 2.1 time: 0.227997 Nov 02 12:34:57.924987 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 23/50] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/flavors/420658425 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:57.932916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.933751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.946843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.947851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.948643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.949690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.950366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.951007 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.957212 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-23aec179-0407-4932-b584-6a6356b9c715 tempest-KeyPairsV210TestJSON-843703371 tempest-KeyPairsV210TestJSON-843703371-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300920194?user_id=832102ac300e41f696c8a0eb247148df" status: 204 len: 0 microversion: 2.10 time: 0.147647 Nov 02 12:34:57.958425 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 28/51] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1300920194?user_id=832102ac300e41f696c8a0eb247148df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:34:57.974266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-68722a93-1571-4065-a654-5d52cf36aced tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.026389 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-68722a93-1571-4065-a654-5d52cf36aced tempest-FlavorsExtraSpecsNegativeTestJSON-704299160 tempest-FlavorsExtraSpecsNegativeTestJSON-704299160-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066530 Nov 02 12:34:58.028307 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 29/52] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:58.280426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.298544 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-39103fbb-26cc-49ef-b1ca-f2ad2a3950f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.369254 Nov 02 12:34:58.299263 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 24/53] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:58.535472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.535472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.535472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.535472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.537005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.537005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.537005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.537005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.557941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.568935 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f3b89c56-7f4a-4f16-909c-30f4589b4872 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1298 microversion: 2.1 time: 0.102576 Nov 02 12:34:58.723805 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 30/54] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:59.326188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.327934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.342511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.349403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.349403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.349403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.349403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.349771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.557034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:59.568629 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fe8e7f31-435b-4bf4-99d1-be3a757595bd tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.247391 Nov 02 12:34:59.574044 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 25/55] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:59.737569 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.738900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.746101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.747028 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.747639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.748562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.749641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.750751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.083246 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.102425 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bdfe1766-1ae6-4699-b1a5-9358a3483c2a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.369908 Nov 02 12:35:00.113018 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 31/56] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:00.596568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.597933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:00.619557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.623742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.624277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.625292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.627304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.627765 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.852444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.863465 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3c06b45b-6993-4da3-b5ed-b7ae8b84a1f6 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.272834 Nov 02 12:35:00.864817 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 26/57] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:00 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:01.130063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.130862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.137717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.138534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.138969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.139659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.140105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.140558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.323165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.333524 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aae15738-e696-4fa0-b221-16ef5f604f3a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.207882 Nov 02 12:35:01.334545 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 32/58] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:01.889009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.891511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.894237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:01.899293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.899970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.900601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.901477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.902101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.902528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.110195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.118585 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-255b486a-b264-44f7-a4c0-496f0581c2e1 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.233494 Nov 02 12:35:02.119618 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 27/59] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:02.362836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.395526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.395526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=12 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:02.395526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.395526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.396332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.396332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.396332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.396332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.560535 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.576716 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-41dec765-6fd5-4bcd-8642-af51450db15b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.217396 Nov 02 12:35:02.578863 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 33/60] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:03.149493 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.153769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.175375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.180966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.182294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.186703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.191367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.192160 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.451916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:03.465675 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-29838ef2-b0ee-43c9-9d82-d69f4d69ee87 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.324290 Nov 02 12:35:03.481498 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 28/61] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:03.607693 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.608528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.619200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.624359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.624359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.624359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.624359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.624783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.809143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:03.818811 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20a21b9b-cb86-4aa6-bd5e-7db81a91d43f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.216264 Nov 02 12:35:03.820559 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 34/62] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:04.492472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.493435 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.501931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.503773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.504397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.507016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.519954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.520865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.699661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.713830 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eed60992-6e74-4f64-95c2-c462f27490f5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.225812 Nov 02 12:35:04.714847 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 29/63] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:04.842906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.847979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.861378 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.864046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.865836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.866745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.868190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.868983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.033001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.041090 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2a63317b-aa4a-4650-97a0-1ecd0efae666 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.202103 Nov 02 12:35:05.041761 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 35/64] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:05.741286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.742120 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.748158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.777899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.777899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.777899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.777899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.778304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.887403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.895716 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1cd3163b-d444-4c9e-b8e2-023c639d43d0 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.159235 Nov 02 12:35:05.896300 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 30/65] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.067681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.068252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.074911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.075644 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.076204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.076950 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.077412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.077843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.250123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.258949 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-57109934-863c-4c43-acbc-e20ce7df5c41 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.196312 Nov 02 12:35:06.262922 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 36/66] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.925466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.925466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.928248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:06.931847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.932372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.932839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.933546 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.933991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.934478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.127701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.137722 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af9fa314-2b9d-496c-803b-696887639845 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.217587 Nov 02 12:35:07.139018 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 31/67] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.286719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.287332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.289827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=18 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:07.295578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.296149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.297567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.298530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.299599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.300575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.429102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=16 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:07.482414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.493481 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b4e424da-99af-48de-9f9f-873420d9c2b1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.209734 Nov 02 12:35:07.494882 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 37/68] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.606527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5eb60ab7-28bb-4741-871a-c10d7293f2f2 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.611844 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5eb60ab7-28bb-4741-871a-c10d7293f2f2 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Nov 02 12:35:07.623039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad553213-11bc-457c-8ce8-cf05153730cf tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Calling method '.version_select at 0x7eff5d36f1f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5eb60ab7-28bb-4741-871a-c10d7293f2f2 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin] Request method failure captured: Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmP7FUTVO1xFTceV9c98kYIvYMOJ4z9ZWex4m55EWDffXgXuLvoqo2p8Mwwc5OeVisJA0YauLWDAOEpf2_K_Ek0OfD1ORovJHocvBCD9gESE9LJbmp1mliKPjMys7wdj0UbaiqF_uiMb4sHSAd3N-5eJUvG50S7NImkbKmsPD7tzkGE Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1f15c4db967845f387ede6b5345add8a Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:07.660533 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1f15c4db967845f387ede6b5345add8a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f15c4db967845f387ede6b5345add8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1f15c4db967845f387ede6b5345add8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1f15c4db967845f387ede6b5345add8a"}]}] Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1f15c4db967845f387ede6b5345add8a Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 889406eab1d94fdc9f42d7556f0b9c8c Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:07.661789 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid timestamp for date invalid_time Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'invalid_time'} Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:07.662413 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5eb60ab7-28bb-4741-871a-c10d7293f2f2 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:07.664449 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5eb60ab7-28bb-4741-871a-c10d7293f2f2 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232 tempest-InstanceUsageAuditLogNegativeTestJSON-2087138232-project-admin] 10.222.0.64 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.240205 Nov 02 12:35:07.670787 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 32/69] 10.222.0.64 () {58 vars in 1224 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 243 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:07.865799 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ad553213-11bc-457c-8ce8-cf05153730cf tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 371 microversion: 2.1 time: 0.364306 Nov 02 12:35:07.865799 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 38/70] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 371 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:07.918572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73c2d9eb-9e4b-4408-927e-f8d233fe182c tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.921485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-73c2d9eb-9e4b-4408-927e-f8d233fe182c tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '45e6263042c94e4f9e917ecd8621ed1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3560f0215ea4522a9e696b9c895cce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.929733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27803c15-7b11-4d1d-84ed-ef4492e0b8ea tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1105727708", "id": 308601968, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73c2d9eb-9e4b-4408-927e-f8d233fe182c tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Request method failure captured: Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmP5bMdGUyvFOuASHbDPjnRfIT8znrQOGIkxDnEaQOHDGyHYglzwjTRJffMtzxvNfQnWDuWgm69bDR_xnq7aBSd6_C2oW1dnUv3z0w_Jrmew5FxroXua_PheTfBcLAJFFOK2_thYNy-gRsDrCfrRLfu7vQijB54GTQH3MYHSacvL1s8 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e3560f0215ea4522a9e696b9c895cce2 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:07.939541 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3560f0215ea4522a9e696b9c895cce2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3560f0215ea4522a9e696b9c895cce2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3560f0215ea4522a9e696b9c895cce2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3560f0215ea4522a9e696b9c895cce2"}]}] Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e3560f0215ea4522a9e696b9c895cce2 Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 45e6263042c94e4f9e917ecd8621ed1b Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project Nov 02 12:35:07.941433 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:07.942147 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Nov 02 12:35:07.943381 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:07.945422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73c2d9eb-9e4b-4408-927e-f8d233fe182c tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:07.946288 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-73c2d9eb-9e4b-4408-927e-f8d233fe182c tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] 10.222.0.64 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.271650 Nov 02 12:35:07.946858 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 33/71] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:35:07.954480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d426160>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:08.030105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.030596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.031091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.032769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.033588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.034066 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.043561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:08.051191 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27803c15-7b11-4d1d-84ed-ef4492e0b8ea tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.188459 Nov 02 12:35:08.054952 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 39/72] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:35:07 2022] POST /compute/v2.1/flavors => generated 446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:08.060869 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-538b3ac9-acec-4bad-b151-282487a6c7e8 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.063736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-538b3ac9-acec-4bad-b151-282487a6c7e8 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '45e6263042c94e4f9e917ecd8621ed1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3560f0215ea4522a9e696b9c895cce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-538b3ac9-acec-4bad-b151-282487a6c7e8 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Request method failure captured: Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012:35:07 HTTP/1.1 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmP5bMdGUyvFOuASHbDPjnRfIT8znrQOGIkxDnEaQOHDGyHYglzwjTRJffMtzxvNfQnWDuWgm69bDR_xnq7aBSd6_C2oW1dnUv3z0w_Jrmew5FxroXua_PheTfBcLAJFFOK2_thYNy-gRsDrCfrRLfu7vQijB54GTQH3MYHSacvL1s8 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: e3560f0215ea4522a9e696b9c895cce2 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:08.065737 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3560f0215ea4522a9e696b9c895cce2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3560f0215ea4522a9e696b9c895cce2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3560f0215ea4522a9e696b9c895cce2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3560f0215ea4522a9e696b9c895cce2"}]}] Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: e3560f0215ea4522a9e696b9c895cce2 Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 45e6263042c94e4f9e917ecd8621ed1b Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project Nov 02 12:35:08.067126 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '2022-11-02 12:35:07'} Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:08.067782 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Nov 02 12:35:08.069005 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:08.070232 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-538b3ac9-acec-4bad-b151-282487a6c7e8 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:08.070784 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-538b3ac9-acec-4bad-b151-282487a6c7e8 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323 tempest-InstanceUsageAuditLogNegativeTestJSON-2101288323-project] 10.222.0.64 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 12:35:07" status: 403 len: 128 microversion: 2.1 time: 0.016873 Nov 02 12:35:08.071871 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 40/73] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012%3A35%3A07 => generated 128 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:08.133610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fa188d9-0f74-4d89-891c-3622a0f51fd9", "tag": "624085ac-e80e-4556-a729-8464e383c7b2"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:08.147411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.148398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.149046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.192289 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Creating event network-changed:624085ac-e80e-4556-a729-8464e383c7b2 for instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 on n-h2-857339-6 Nov 02 12:35:08.195633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:35:08.195633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-faa5f354-f646-4961-9da9-6da16e9c5710 req-4195b622-db08-4ab6-af66-1a74c0a076e8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:35:08.195633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.195633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.196029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.197083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.197644 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.201704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.215131 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-05f68719-52fc-49aa-8211-ef0efb219906 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 328 microversion: 2.1 time: 0.266793 Nov 02 12:35:08.228561 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 34/74] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:07 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 328 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:08.335863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54cd9feb-e62a-4de7-b318-4591d83cd892 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.347840 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-54cd9feb-e62a-4de7-b318-4591d83cd892 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] 10.222.0.64 "GET /compute/v2.1/flavors/308601968" status: 200 len: 446 microversion: 2.55 time: 0.130294 Nov 02 12:35:08.348757 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 35/75] 10.222.0.64 () {60 vars in 1196 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/flavors/308601968 => generated 446 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:08.353408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.354597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.370306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.373291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.373291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.373291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.373291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.373801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.425885 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.compute.rpcapi [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:35:08.427091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:35:08.445968 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d7ec710d-573a-4ed8-84c1-0f325d66a9c8 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372588 Nov 02 12:35:08.447244 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 41/76] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:08.454178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-24e0bbd2-c54b-41f0-b0d8-7f9a0bc79f94 tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] Action: 'update', calling method: .version_select at 0x7eff5e349b80>, body: {"flavor": {"description": "new"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:08.528751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.537698 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-941972e3-a0d9-4da0-b57a-295b0e19024c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.188151 Nov 02 12:35:08.538293 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 36/77] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:08.600305 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1470621392", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:08.664147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:08.706060 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-24e0bbd2-c54b-41f0-b0d8-7f9a0bc79f94 tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] 10.222.0.64 "PUT /compute/v2.1/flavors/308601968" status: 200 len: 447 microversion: 2.55 time: 0.257338 Nov 02 12:35:08.706681 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 42/78] 10.222.0.64 () {62 vars in 1216 bytes} [Wed Nov 2 12:35:08 2022] PUT /compute/v2.1/flavors/308601968 => generated 447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:08.711637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.712390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.721649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.721649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.721649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.721649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.722118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.722346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.918580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.927580 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-058d794a-a7f7-4105-b380-9057da0d03f4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.219815 Nov 02 12:35:08.928182 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 43/79] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:08.933202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dd497fde-f7e3-468b-afb5-560e5343a771 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.964764 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:08.965305 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:08.965637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:08.966051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:08.966794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:08.973040 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dd497fde-f7e3-468b-afb5-560e5343a771 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.043562 Nov 02 12:35:08.989404 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 44/80] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:08.989797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.989797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.989797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.989797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.990135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.990135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.995328 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-58d5640a-5c40-47bc-9c7c-26b0fda03626 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.998657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:09.003426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for user 24b22ee41c3d4fdeb0152828002c6b04 and project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:09.016100 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.utils [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] cores quota exceeded for 633337daf8c944329d1a7d85446af8c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127766) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:35:09.017005 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:35:09.017287 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-58d5640a-5c40-47bc-9c7c-26b0fda03626 tempest-FlavorsV255TestJSON-115459026 tempest-FlavorsV255TestJSON-115459026-project] 10.222.0.64 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.027485 Nov 02 12:35:09.020670 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 45/81] 10.222.0.64 () {60 vars in 1166 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Request method failure captured: Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 145 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmP5OQ7J1s9LmasZ7q7JsP6_L8S7i41SCJXARmj8zd0lTlIQauJdRnJJP4RnzbQ6cKsAIcrw3V3NUNK4nj-I_Fj-Q_H8aqNX5ZzL2SxKYam1KkASsv2tV4CmlUP9SZLXzaDQ2n0BuhgM_zMw5gT9l-bO1tE1tzqsLS27OKG8EDaS0-c Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:09.024129 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_633337daf8c944329d1a7d85446af8c7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}] Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 24b22ee41c3d4fdeb0152828002c6b04 Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1470621392", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} Nov 02 12:35:09.025520 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1470621392', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452'}}} Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:35:09.026309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:09.027594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.028934 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Nov 02 12:35:09.030275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:09.032200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:09.033437 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0f3d6943-bf11-4044-88aa-c4871ff55d57 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.494212 Nov 02 12:35:09.034314 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 37/82] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:08 2022] POST /compute/v2.1/servers => generated 111 bytes in 495 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:09.036420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-80ccd68b-01e7-4c6f-9773-87f6aa6681bf tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.043586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d1a24c0>, body: {"quota_set": {"cores": 20}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:09.169116 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-80ccd68b-01e7-4c6f-9773-87f6aa6681bf tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/308601968" status: 202 len: 0 microversion: 2.55 time: 0.136931 Nov 02 12:35:09.169706 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 46/83] 10.222.0.64 () {60 vars in 1199 bytes} [Wed Nov 2 12:35:09 2022] DELETE /compute/v2.1/flavors/308601968 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:35:09.180976 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9c62b4a4-b1d5-4367-bcda-e7e6bcf3795f tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.201615 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9c62b4a4-b1d5-4367-bcda-e7e6bcf3795f tempest-FlavorsV255TestJSON-575105577 tempest-FlavorsV255TestJSON-575105577-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.027197 Nov 02 12:35:09.202233 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 47/84] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:09.250707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.250707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.250707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.250707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.251105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.252229 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.500476 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-29179ccd-85a0-4e29-9325-26216f938009 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 329 microversion: 2.1 time: 0.460886 Nov 02 12:35:09.501017 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 38/85] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:09 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 329 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:09.513430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e88c2eec-f925-45b9-850d-ba938b8fb31f tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Calling method '.version_select at 0x7eff5d266550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.562879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.566630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.578264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.578949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.579432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.580164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.580699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.581187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.599619 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e88c2eec-f925-45b9-850d-ba938b8fb31f tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 371 microversion: 2.1 time: 0.089801 Nov 02 12:35:09.600527 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 48/86] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 371 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:09.613008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d1adb80>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:09.723595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.731738 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8f7b28b2-1fda-4b11-8c8e-ecc2c3d468cf tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.174500 Nov 02 12:35:09.732319 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 39/87] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:09.957333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.958835 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.964796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.965449 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.965855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.966657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.967196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.967690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.002610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.007980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.008563 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.009411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.010023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.010740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.069177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=82,nova_api:SAVEPOINT=4,nova_api:INSERT=3,nova_api:RELEASE=4,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.174731 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.185920 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-38d5c77f-5f19-44ca-a6ea-cfd5b8988264 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.233644 Nov 02 12:35:10.187736 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 40/88] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:10.209498 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fa12d800-f6cf-4f32-974f-7faf9f1e2ee3 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 328 microversion: 2.1 time: 0.600747 Nov 02 12:35:10.210294 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 49/89] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:09 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 328 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:10.338272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-918617345", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:10.403717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:10.502021 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "897625a4-b4a8-4753-ae04-d1a24f14d3fa", "tag": "159018c2-9f4c-4fdd-ba89-9139a399c69e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:10.514782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.515467 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.515884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.531271 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] Creating event network-changed:159018c2-9f4c-4fdd-ba89-9139a399c69e for instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa on n-h2-857339-6 Nov 02 12:35:10.536898 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-e22fef87-3f0b-445b-b867-f98352dfd063 req-177177a9-e3c5-40bb-9ca4-7df3946fbb55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039991 Nov 02 12:35:10.538044 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 50/90] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:10.758605 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.759643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.765748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:10.766203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:10.766706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:10.767111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:10.771584 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:10.773200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.774066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.774509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.775217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.775671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.776089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.781660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:10.781828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.782306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.782928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.783831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.784296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.784748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.807776 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:10.812289 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for user 24b22ee41c3d4fdeb0152828002c6b04 and project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:10.829933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.utils [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] instances quota exceeded for 633337daf8c944329d1a7d85446af8c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127766) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:35:10.830478 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Request method failure captured: Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 144 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmP5OQ7J1s9LmasZ7q7JsP6_L8S7i41SCJXARmj8zd0lTlIQauJdRnJJP4RnzbQ6cKsAIcrw3V3NUNK4nj-I_Fj-Q_H8aqNX5ZzL2SxKYam1KkASsv2tV4CmlUP9SZLXzaDQ2n0BuhgM_zMw5gT9l-bO1tE1tzqsLS27OKG8EDaS0-c Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:10.832441 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_633337daf8c944329d1a7d85446af8c7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}] Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 24b22ee41c3d4fdeb0152828002c6b04 Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-918617345", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} Nov 02 12:35:10.833956 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-918617345', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452'}}} Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:35:10.834754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:10.835880 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.837189 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-caefca89-323b-453a-ac81-7c15340a3b2c tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.502852 Nov 02 12:35:10.838440 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 41/91] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:10 2022] POST /compute/v2.1/servers => generated 119 bytes in 505 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:10.844666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d127160>, body: {"quota_set": {"instances": 10}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:10.942162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.951571 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8b84da66-d725-444e-b722-52d724db4411 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.200114 Nov 02 12:35:10.952577 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 51/92] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:11.098308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.098875 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.099336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.100072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.100568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.100983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.211426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.212080 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.222150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.222647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.223086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.223805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.224314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.224808 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.410347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.410347 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-64bad1ef-f5c2-4188-be85-f7d3d763bbcb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.167464 Nov 02 12:35:11.410347 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 52/93] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:11.825765 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-73938d00-f73f-4932-9707-450999fdf901 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 329 microversion: 2.1 time: 0.985800 Nov 02 12:35:11.826355 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 42/94] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:10 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 329 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:11.838923 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c3847315-5421-4ea1-b364-21bbcb85490d tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Calling method '.version_select at 0x7eff5d272820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.912661 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c3847315-5421-4ea1-b364-21bbcb85490d tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 371 microversion: 2.1 time: 0.077247 Nov 02 12:35:11.913260 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 53/95] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:11.925686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d1273a0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:11.980281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.981151 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.990909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.991661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.992251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.993352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.994636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.995403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.152976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.154153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.154153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.155159 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.156386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.157025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.169893 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.178450 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8b4c4fa7-e00b-4de9-a69e-bd81a24e4642 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.206491 Nov 02 12:35:12.179261 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 54/96] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.355286 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-97f0c544-693d-4350-a051-b31e50e66fb7 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 325 microversion: 2.1 time: 0.433776 Nov 02 12:35:12.362266 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 43/97] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:11 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 325 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:12.430635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.431279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.439200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.439695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.440130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.440871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.441329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.441760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.583724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.595390 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-802a9416-7bee-4c6f-bff7-b2cc8970f0a3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.168977 Nov 02 12:35:12.596566 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 55/98] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.706305 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-549545840", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:12.767539 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:13.162674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:13.163922 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:13.164700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:13.165445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:13.166105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:13.184980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.185846 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.186368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.187419 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.188154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.188813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.207581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.208214 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.215285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:13.217337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:13.223045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.223851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.224834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.225756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.226380 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.227134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.233142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Getting quotas for user 24b22ee41c3d4fdeb0152828002c6b04 and project 633337daf8c944329d1a7d85446af8c7. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:13.268702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.utils [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] ram quota exceeded for 633337daf8c944329d1a7d85446af8c7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=127766) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Nov 02 12:35:13.269507 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Request method failure captured: Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 144 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmP5OQ7J1s9LmasZ7q7JsP6_L8S7i41SCJXARmj8zd0lTlIQauJdRnJJP4RnzbQ6cKsAIcrw3V3NUNK4nj-I_Fj-Q_H8aqNX5ZzL2SxKYam1KkASsv2tV4CmlUP9SZLXzaDQ2n0BuhgM_zMw5gT9l-bO1tE1tzqsLS27OKG8EDaS0-c Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:13.282179 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_633337daf8c944329d1a7d85446af8c7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}] Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 24b22ee41c3d4fdeb0152828002c6b04 Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-549545840", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} Nov 02 12:35:13.286953 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-549545840', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452'}}} Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Nov 02 12:35:13.287764 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:13.293132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.295617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1281e240-c11f-45f8-94c3-7f6c92c1a283 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.585647 Nov 02 12:35:13.298734 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 44/99] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:12 2022] POST /compute/v2.1/servers => generated 110 bytes in 587 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:13.307231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d2b1160>, body: {"quota_set": {"ram": 51200}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:13.433365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.443334 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-11b48ee4-98c9-495e-9fda-9bfc7e5022fc tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.244754 Nov 02 12:35:13.443934 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 56/100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:13.619271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.619942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.627638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.628154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.628692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.629561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.630170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.630773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.667008 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.667403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.668748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.669706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.672837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.673358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.790332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.798421 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6dfc11e0-ec38-4455-95c9-209a18ddd99c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.183219 Nov 02 12:35:13.799009 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 57/101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.850678 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ae305807-29d0-4772-8440-f7762733d715 tempest-QuotasAdminNegativeTest-225223875 tempest-QuotasAdminNegativeTest-225223875-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 200 len: 329 microversion: 2.1 time: 0.557012 Nov 02 12:35:13.863843 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 45/102] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:13 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 329 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:13.867735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-384478c9-7b13-4d1b-9757-3777757fba65 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Action: 'update', calling method: .version_select at 0x7eff5d1a0940>, body: {"quota_set": {"ram": 0}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:13.875130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-384478c9-7b13-4d1b-9757-3777757fba65 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '24b22ee41c3d4fdeb0152828002c6b04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633337daf8c944329d1a7d85446af8c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-384478c9-7b13-4d1b-9757-3777757fba65 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Request method failure captured: Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: request: PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 HTTP/1.1 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 25 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmP5OQ7J1s9LmasZ7q7JsP6_L8S7i41SCJXARmj8zd0lTlIQauJdRnJJP4RnzbQ6cKsAIcrw3V3NUNK4nj-I_Fj-Q_H8aqNX5ZzL2SxKYam1KkASsv2tV4CmlUP9SZLXzaDQ2n0BuhgM_zMw5gT9l-bO1tE1tzqsLS27OKG8EDaS0-c Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:13.877562 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_633337daf8c944329d1a7d85446af8c7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/633337daf8c944329d1a7d85446af8c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/633337daf8c944329d1a7d85446af8c7"}]}] Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 633337daf8c944329d1a7d85446af8c7 Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1529462462 Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 24b22ee41c3d4fdeb0152828002c6b04 Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-QuotasAdminNegativeTest-1529462462-project Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: {"quota_set": {"ram": 0}} Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:35:13.878913 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '633337daf8c944329d1a7d85446af8c7', 'body': {'quota_set': {'ram': 0}}} Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:13.879695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.880857 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-384478c9-7b13-4d1b-9757-3777757fba65 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-384478c9-7b13-4d1b-9757-3777757fba65 tempest-QuotasAdminNegativeTest-1529462462 tempest-QuotasAdminNegativeTest-1529462462-project] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7" status: 403 len: 116 microversion: 2.1 time: 0.016015 Nov 02 12:35:13.883276 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 58/103] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:35:13 2022] PUT /compute/v2.1/os-quota-sets/633337daf8c944329d1a7d85446af8c7 => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:14.467569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.468813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.475762 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.476281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.476747 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.477454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.477906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.478460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.698191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.710936 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1537e96c-6bd0-49fa-9f4c-58b6d243c785 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.247362 Nov 02 12:35:14.713184 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 46/104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:14.821977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.822738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.978979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.979725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.980172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.980950 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.981453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.981881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.238615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.251193 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3bfa3d95-e752-42a3-b26e-c316c0d18932 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.433735 Nov 02 12:35:15.251931 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 59/105] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:15.741249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.742375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.756420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.757152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.758163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.759904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.761748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.762754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.965241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.973595 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7f85263a-c961-40b3-9e68-3050931d2037 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.240139 Nov 02 12:35:15.974195 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 47/106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:16.274391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.275336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.281643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.282139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.282778 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.283657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.284124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.284578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.390562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa188d9-0f74-4d89-891c-3622a0f51fd9", "name": "network-vif-plugged", "status": "completed", "tag": "624085ac-e80e-4556-a729-8464e383c7b2"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:16.415223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.416088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.416714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.447356 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] Creating event network-vif-plugged:624085ac-e80e-4556-a729-8464e383c7b2 for instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 on n-h2-857339-6 Nov 02 12:35:16.462235 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-3bfb3e25-9641-4638-9bbc-f3a058c372b8 req-7de03c2f-0a75-4e63-b044-bfad448085b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246902 Nov 02 12:35:16.462877 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 60/107] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:16.527240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.542562 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-63ce2637-a713-4882-9c35-d4f8d9b2974b tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.271935 Nov 02 12:35:16.543167 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 48/108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:16.610515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Calling method '.version_select at 0x7eff5d288e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.614703 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.615422 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.615865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.634469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.635203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.635826 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.675711 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.676279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.676685 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.697480 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.698083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.698695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.713456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.714245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.714988 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.722683 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-85329560-6f08-4cc2-9ddd-cf42ca516c78 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.182784 Nov 02 12:35:16.727336 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 61/109] 10.222.0.64 () {60 vars in 1243 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:16.745978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Calling method '.version_select at 0x7eff5d2b18b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.749999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.750489 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.750928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.771497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.771497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.771497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.819886 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.821263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.821884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.837495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.842086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.842086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.857816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.859124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.859726 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.867251 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-afc23f09-93c8-4e28-8d74-bb0e0c03f67b tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 436 microversion: 2.53 time: 0.126801 Nov 02 12:35:16.876030 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 49/110] 10.222.0.64 () {60 vars in 1222 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 436 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:16.882558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Calling method '.version_select at 0x7eff5d288280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.889866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.891050 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.891717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.913685 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.914604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.915862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.926150 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8a25d708-b43d-4e39-b057-e85d15a86530 tempest-HypervisorAdminV253TestBase-1045500387 tempest-HypervisorAdminV253TestBase-1045500387-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/c6b17963-f55a-4b7e-a8e1-e7202a0f8d08" status: 200 len: 792 microversion: 2.53 time: 0.048455 Nov 02 12:35:16.927756 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 62/111] 10.222.0.64 () {60 vars in 1298 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/os-hypervisors/c6b17963-f55a-4b7e-a8e1-e7202a0f8d08 => generated 792 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:16.998728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.999719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:17.007232 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.007732 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.008396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.009158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.009615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.010238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.248097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.266958 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5af88e3e-9b0f-41c1-8992-96522a93d65c tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.273242 Nov 02 12:35:17.269335 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 50/112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:17.584544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:17.585306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:17.605344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.605858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.609310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.610850 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.611490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.613088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.831803 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.841059 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-56345eb7-371b-4e8f-85ca-c66791584d19 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.260833 Nov 02 12:35:17.841766 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 63/113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:17 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.294538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.295147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.301472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.301947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.302387 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.303100 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.303703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.304126 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.483038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897625a4-b4a8-4753-ae04-d1a24f14d3fa", "name": "network-vif-plugged", "status": "completed", "tag": "159018c2-9f4c-4fdd-ba89-9139a399c69e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:18.506795 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.507504 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.508101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.552696 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] Creating event network-vif-plugged:159018c2-9f4c-4fdd-ba89-9139a399c69e for instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa on n-h2-857339-6 Nov 02 12:35:18.580770 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-314d9507-6be9-4323-ad04-257447e79d12 req-f9ef7a55-9af9-42f1-962c-e80d784a52f3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102245 Nov 02 12:35:18.581111 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 64/114] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:18.600857 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:18.612333 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-90249187-a0ad-4ec2-8c6c-c942536b9d8e tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1336 microversion: 2.1 time: 0.321807 Nov 02 12:35:18.613156 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 51/115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1336 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:18.865691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.867245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:18.884939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.885677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.886800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:18.887768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:18.888356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:18.888941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.102686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.111307 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d351ec7b-aa3e-4c27-8551-22e6f5b0f05f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.250315 Nov 02 12:35:19.112135 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 65/116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.638484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.639107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.645914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.646414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.646851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.653569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.654094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.654534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.946596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.961667 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1c9c4d4b-5102-440f-bda3-aba95ce0dd8b tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1486 microversion: 2.1 time: 0.327477 Nov 02 12:35:19.962639 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 52/117] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1486 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:19.987289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:19.988290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:20.007907 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.015194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.015806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.019603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.022525 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.023198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.024914 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:20.144965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:20.147617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:20.158261 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.160078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.160078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.160078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.160847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.161353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.710105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.741363 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f18345b3-dae6-48ec-8a87-67d250ed6775 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1340 microversion: 2.1 time: 0.592876 Nov 02 12:35:20.741363 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 53/118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:20 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1340 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:21.113625 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e22fca77-07ce-4f4e-a4f5-7d56ab0eea4b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1637 microversion: 2.1 time: 1.131778 Nov 02 12:35:21.114889 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 66/119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:19 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1637 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:21.140847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.141786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.149181 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.149935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.150526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.151236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.151745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.152274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.186032 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:21.402631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:21.521248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "compute-rpcapi-router" {{(pid=127766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:35:21.522141 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-91c2b634-0fd1-4eb1-a3e4-a113a44ddb89 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquired lock "compute-rpcapi-router" {{(pid=127766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:35:21.523491 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.524263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.524953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.525857 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.526309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.526728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.540888 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.compute.rpcapi [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:35:21.541819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] Releasing lock "compute-rpcapi-router" {{(pid=127766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:35:21.688654 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb2e965b-3923-4f94-bc3b-c5d6ec9c00c7 None None] 10.222.0.64 "DELETE /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 204 len: 0 microversion: 2.1 time: 0.553346 Nov 02 12:35:21.689414 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 54/120] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:21 2022] DELETE /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:21.698960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.699757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.710322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.716308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.717298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.718883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.719576 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.720542 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.753643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.755042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.770147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.771584 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.772635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.774390 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.777805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.781024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.906825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=14 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:22.094813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.108831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.110542 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fc3fbc22-6089-4441-9716-95de6d364021 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1492 microversion: 2.1 time: 0.415676 Nov 02 12:35:22.113254 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 67/121] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1492 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:22.122158 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-61e30db2-9ada-4056-b866-137fc0b3ed65 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1489 microversion: 2.1 time: 0.374025 Nov 02 12:35:22.132745 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 55/122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1489 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:22.369917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:22.373169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:22.386272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.387591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.390196 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.392026 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:22.393433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:22.394043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.442292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:22.676561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:22.990334 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20eff8e9-183f-4bf0-9894-ae2eb41b67a3 tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] 10.222.0.64 "DELETE /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 204 len: 0 microversion: 2.1 time: 0.839292 Nov 02 12:35:22.996941 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 68/123] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:22 2022] DELETE /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 0 bytes in 843 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:23.002908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.003882 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.014001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.017097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.024344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.024344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.024344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.024344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.139757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.140650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.157071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.157566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.158276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.159157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.160197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.160819 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.202326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.202326 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c28513c0-2ee5-4049-bd0a-e75365197712 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1495 microversion: 2.1 time: 0.197782 Nov 02 12:35:23.202326 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 56/124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:22 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1495 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:23.308136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.318049 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5b2241a2-49cc-456a-acad-baffc6258a13 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1492 microversion: 2.1 time: 0.183134 Nov 02 12:35:23.318554 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 69/125] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:23 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1492 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:24.221096 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.222594 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.226412 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=58 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:24.231634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.232124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.232743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.235413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.235413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.235413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.397751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.411688 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-114b9365-bb69-4ac0-8b9f-fde9db331c25 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1495 microversion: 2.1 time: 0.195159 Nov 02 12:35:24.419415 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 57/126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:24 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1495 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:24.425767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.427326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.445961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.446556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.446999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.447706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.448160 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.448894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.758261 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-398049080", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:24.850043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:24.853952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:24.864077 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-12115e52-ab13-4b07-b6ab-551e01c4d232 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1492 microversion: 2.1 time: 0.443586 Nov 02 12:35:24.879276 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 58/127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:24 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1492 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:25.453017 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.454468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.468538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.469366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.469994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.470904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.472312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.473004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.537177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:25.537860 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:25.538406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:25.538971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:25.539453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:25.556279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.557067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.557995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.558925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.559433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.559854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.583569 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:25.588387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for user 976993a09f2342c68dab07da6a7dd236 and project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:25.602185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:25.610032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:25.778042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.790427 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-422cdc2a-71a3-43e6-98a2-a007a89eb7cd tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1495 microversion: 2.1 time: 0.341469 Nov 02 12:35:25.807022 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 59/128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1495 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:25.824198 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-13216348-17ac-4419-b1cf-ea4547d7f179 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584994 Nov 02 12:35:25.834164 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 70/129] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:25.836911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-791b646b-3035-473a-8115-30a2bc46ef25 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.838345 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-791b646b-3035-473a-8115-30a2bc46ef25 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.877989 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fa188d9-0f74-4d89-891c-3622a0f51fd9", "name": "network-vif-deleted", "tag": "624085ac-e80e-4556-a729-8464e383c7b2"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:25.915261 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.915773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.916216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.939285 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] Creating event network-vif-deleted:624085ac-e80e-4556-a729-8464e383c7b2 for instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 on n-h2-857339-6 Nov 02 12:35:25.947930 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-11161c1f-6bf0-41de-ab6e-d5a2dc91447f req-c1179e59-0432-4c71-a79d-229f494d188f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073938 Nov 02 12:35:25.948757 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 71/130] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:25.970946 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:25.971731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:25.998005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:25.998564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:25.999009 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.999923 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.000393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.000867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.027262 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-791b646b-3035-473a-8115-30a2bc46ef25 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.035536 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-791b646b-3035-473a-8115-30a2bc46ef25 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1212 microversion: 2.1 time: 0.202848 Nov 02 12:35:26.041567 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 60/131] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1212 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:26.248267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.259208 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-111faa67-2002-4fca-983e-34e54f42c263 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1450 microversion: 2.1 time: 0.309214 Nov 02 12:35:26.277119 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 72/132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:25 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1450 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:26.650113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897625a4-b4a8-4753-ae04-d1a24f14d3fa", "name": "network-vif-deleted", "tag": "159018c2-9f4c-4fdd-ba89-9139a399c69e"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:26.667883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.668607 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.669149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.703946 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] Creating event network-vif-deleted:159018c2-9f4c-4fdd-ba89-9139a399c69e for instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa on n-h2-857339-6 Nov 02 12:35:26.726055 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-41456dde-48a5-4f6b-81f8-4ad0c964bfa8 req-42a93aa3-e9a7-43bb-aa61-94035f99973f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178513 Nov 02 12:35:26.728939 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 61/133] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:26.816779 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.821407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:26.828994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.829647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.829932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.830650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.831319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.831746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.879679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.880587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.881171 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.882272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 897625a4-b4a8-4753-ae04-d1a24f14d3fa {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:26.941149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.951087 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cd0de4cb-dd9c-4972-9c4f-24329c258d5f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 200 len: 1330 microversion: 2.1 time: 0.138135 Nov 02 12:35:26.952012 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 73/134] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 1330 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.087385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-43cd854a-328d-4718-8a0a-14895e2be6f8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.089002 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-43cd854a-328d-4718-8a0a-14895e2be6f8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.140615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-427297447", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:27.209860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:27.216125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-43cd854a-328d-4718-8a0a-14895e2be6f8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.237649 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-43cd854a-328d-4718-8a0a-14895e2be6f8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1212 microversion: 2.1 time: 0.173824 Nov 02 12:35:27.242831 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 74/135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1212 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.284724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.285708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.293647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.294726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.295563 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.297049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.297776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.298346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.344335 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.345219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.345868 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.346605 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lazy-loading 'fault' on Instance uuid 1fa188d9-0f74-4d89-891c-3622a0f51fd9 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:27.454779 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f441720944f34d6dad78783005fa6165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dbe11c2ed6c436caf0eb7c8da9beed5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.469257 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e80ae666-ab1c-4832-acef-e3d12c531bca tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 200 len: 1326 microversion: 2.1 time: 0.188512 Nov 02 12:35:27.470405 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 75/136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 1326 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.700030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:27.700588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:27.700998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:27.702927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:27.703388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:27.727853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.728407 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.729333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.729868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.730739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.730958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.777513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:27.783087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for user a0475d03f0e14972a733ba9db2d32947 and project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:27.802436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:27.805272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:27.980753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.984770 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.005964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.015131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.016193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.017219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.021179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.022169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.024862 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b5d3b39c-ab8d-4f83-a72c-cebd244f6fd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038523 Nov 02 12:35:28.037459 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 62/137] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:28.093597 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:35:28.098444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1046466502", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa HTTP/1.1 Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:28.101024 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:35:28.102566 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '897625a4-b4a8-4753-ae04-d1a24f14d3fa'} Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:28.103364 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:35:28.105048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:28.113512 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:28.116441 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3df131a4-bf44-4d26-ad16-02ae15d79abf tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 404 len: 111 microversion: 2.1 time: 0.141565 Nov 02 12:35:28.124463 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 76/138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:35:28.186500 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:28.268324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.270303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.286119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.290302 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.290955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.291909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.292746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.300133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.452663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.463374 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e3b3d616-a4f5-4cd9-a9a3-97991f2e7523 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1208 microversion: 2.1 time: 0.200825 Nov 02 12:35:28.463975 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 77/139] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1208 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:28.473945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-186525285", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:28.627690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:29.072945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:29.073474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:29.074024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:29.074501 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:29.074977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:29.097436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.097927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.101953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.101953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.101953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.101953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.125754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:29.135522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for user a0475d03f0e14972a733ba9db2d32947 and project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:29.151300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:29.153730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:29.239596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:29.240116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:29.240571 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:29.241298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:29.241966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:29.251719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.252931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.253590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.254570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.255011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.255672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.275152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Getting quotas for project 8ea3b8ac6b104721ba07c7b85bbb64aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:29.278073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.282930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Getting quotas for user 936480fc35244d79a3ec7157060a1dbc and project 8ea3b8ac6b104721ba07c7b85bbb64aa. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:29.299180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:29.306286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:29.398062 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a125899e-dc79-41c6-8a33-9ceada8ff3a5 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.304083 Nov 02 12:35:29.398718 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 63/140] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:29.413804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.420364 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.423216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.448649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.449346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.449954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.451193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.452141 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.452815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.470758 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] HTTP exception thrown: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Request method failure captured: Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 HTTP/1.1 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPj5lRVoqGjmfS4FWNmrTb4kcGXUIwhialrfr-GCT6WqYEy731o0hY4yiVXi5hHQ9l60WyfFZeVkAW1JmeMXJ-trkK4DnlZz2xzTJM0u5Wrj-nqMx5n_QgoCJbtQp-Z2xxdjPKdaSZbTo2HsyotbT07H3tsiX-XxMEWVff5egGw7g4 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:29.472932 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1dbe11c2ed6c436caf0eb7c8da9beed5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}] Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: f441720944f34d6dad78783005fa6165 Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:29.474335 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '1fa188d9-0f74-4d89-891c-3622a0f51fd9'} Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:29.475119 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:29.476394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:29.478516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Returning 404 to user: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:29.478516 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e4468430-0e0e-404d-a2e4-1c0a154d84c5 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 404 len: 111 microversion: 2.1 time: 0.074709 Nov 02 12:35:29.478516 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 64/141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:29.483246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-98133f6a-9060-4b99-ad49-c3c45db99b85 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.484041 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-98133f6a-9060-4b99-ad49-c3c45db99b85 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.591786 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-62862de9-e289-40da-9aca-cbf71371d78d tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126596 Nov 02 12:35:29.592969 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 78/142] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:29.609408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5748653a-b6f7-414c-b8ef-cc5a5bd4f3e1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:29.645032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5748653a-b6f7-414c-b8ef-cc5a5bd4f3e1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.645680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5748653a-b6f7-414c-b8ef-cc5a5bd4f3e1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.646562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5748653a-b6f7-414c-b8ef-cc5a5bd4f3e1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.777858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-98133f6a-9060-4b99-ad49-c3c45db99b85 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.789259 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-98133f6a-9060-4b99-ad49-c3c45db99b85 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1214 microversion: 2.1 time: 0.309393 Nov 02 12:35:29.799752 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 65/143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1214 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:29.823446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.824974 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.850186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.863482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.863482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.863482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.863482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.864056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.203980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.212388 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ac321be2-ad25-4823-90d5-c5aa4c391ab5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1282 microversion: 2.1 time: 0.402239 Nov 02 12:35:30.213065 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 66/144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1282 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:30.224698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-283709ed-e693-4949-8f3a-860f04e75cb3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.224698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-283709ed-e693-4949-8f3a-860f04e75cb3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.296664 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-283709ed-e693-4949-8f3a-860f04e75cb3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.303793 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-283709ed-e693-4949-8f3a-860f04e75cb3 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1219 microversion: 2.1 time: 0.089722 Nov 02 12:35:30.304702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 67/145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:30.325446 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5748653a-b6f7-414c-b8ef-cc5a5bd4f3e1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 295 microversion: 2.1 time: 0.731115 Nov 02 12:35:30.327038 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 79/146] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 295 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:30.338639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f386d915-40fb-41f9-9913-966fbbc0de43 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.533519 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f386d915-40fb-41f9-9913-966fbbc0de43 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.198904 Nov 02 12:35:30.534130 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 68/147] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:30.551114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6df576f7-18fb-4d1d-9636-a5fb2867e137 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-805235303"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:30.555161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-6df576f7-18fb-4d1d-9636-a5fb2867e137 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid ed5764b6-4f79-4718-aa64-efdc90b8a68e for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:30.708849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6df576f7-18fb-4d1d-9636-a5fb2867e137 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.162266 Nov 02 12:35:30.713936 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 80/148] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:30 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:30.721538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4e4bac70-6aa3-4789-b262-a6d901efe381 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:30.736944 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4bac70-6aa3-4789-b262-a6d901efe381 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.737677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4bac70-6aa3-4789-b262-a6d901efe381 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.738394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4bac70-6aa3-4789-b262-a6d901efe381 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.821240 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bd953f1c-c077-4b9d-808a-f7a61c7f5018 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.823528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bd953f1c-c077-4b9d-808a-f7a61c7f5018 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.963499 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bd953f1c-c077-4b9d-808a-f7a61c7f5018 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.984749 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bd953f1c-c077-4b9d-808a-f7a61c7f5018 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1214 microversion: 2.1 time: 0.167472 Nov 02 12:35:31.004752 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 81/149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:31.240429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.241298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.250406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.250909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.251344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.252057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.252806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.253771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.350235 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4e4bac70-6aa3-4789-b262-a6d901efe381 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.632570 Nov 02 12:35:31.353983 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 69/150] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:30 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:31.362797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c92536a0-de23-45e8-8d92-08af17cd68f1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.363535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c92536a0-de23-45e8-8d92-08af17cd68f1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.427228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.436978 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3eaa38cf-7a43-4a6d-b5ad-047a447c329a tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1270 microversion: 2.1 time: 0.200704 Nov 02 12:35:31.437575 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 82/151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:31.442557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-65ff10a1-7a65-4b42-9203-e68595163631 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.459272 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-65ff10a1-7a65-4b42-9203-e68595163631 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.018611 Nov 02 12:35:31.459272 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 83/152] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:31.470838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5df77b58-c637-4d0b-bd17-cdfbc0a2624c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:31.484797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5df77b58-c637-4d0b-bd17-cdfbc0a2624c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.485300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5df77b58-c637-4d0b-bd17-cdfbc0a2624c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.485737 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5df77b58-c637-4d0b-bd17-cdfbc0a2624c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.729273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c92536a0-de23-45e8-8d92-08af17cd68f1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.740783 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c92536a0-de23-45e8-8d92-08af17cd68f1 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1219 microversion: 2.1 time: 0.387825 Nov 02 12:35:31.741631 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 70/153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1219 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:31.838756 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5df77b58-c637-4d0b-bd17-cdfbc0a2624c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.371507 Nov 02 12:35:31.843721 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 84/154] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:31.861603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-086ad97b-5633-41f5-a724-0883b25feaee tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.957817 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-086ad97b-5633-41f5-a724-0883b25feaee tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.101888 Nov 02 12:35:31.963185 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 71/155] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:31.988281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a1a7efc8-303b-4c8e-b39b-ee545a9b86a8 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1121921377"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:32.001658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-a1a7efc8-303b-4c8e-b39b-ee545a9b86a8 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid 1b113e75-9ffd-45f9-b15e-c0c426fefc93 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:32.018400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.020706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.039147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.041244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.043886 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.046112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.046812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.047447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.149458 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.151241 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a1a7efc8-303b-4c8e-b39b-ee545a9b86a8 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.177159 Nov 02 12:35:32.152364 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 85/156] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:32.164829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0e0546c0-1b84-4151-8421-1c3acb4df0de tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:32.176598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bfc1136a-f1e1-427a-807f-c9be9404eac7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1210 microversion: 2.1 time: 0.165427 Nov 02 12:35:32.179651 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 72/157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:32.206782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0e0546c0-1b84-4151-8421-1c3acb4df0de tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.207587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0e0546c0-1b84-4151-8421-1c3acb4df0de tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.208294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0e0546c0-1b84-4151-8421-1c3acb4df0de tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.468146 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.470087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.482182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.483375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.484330 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.485809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.486436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.487012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.693902 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0e0546c0-1b84-4151-8421-1c3acb4df0de tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.533363 Nov 02 12:35:32.694633 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 86/158] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:32.708112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f6099d15-e6a6-4043-97ed-270366e7b61c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.724047 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f6099d15-e6a6-4043-97ed-270366e7b61c tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.020325 Nov 02 12:35:32.725084 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 87/159] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:32.739439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ffc2f03-50da-48de-9260-383b2a84ca99 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:32.774120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6ffc2f03-50da-48de-9260-383b2a84ca99 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.774704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6ffc2f03-50da-48de-9260-383b2a84ca99 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.775219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6ffc2f03-50da-48de-9260-383b2a84ca99 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.869467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.907858 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d94e80a7-017e-4bfa-b702-378706dd3150 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.436105 Nov 02 12:35:32.908566 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 73/160] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:32.928371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.933635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.941861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.942644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.943078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.943942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.944404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.944855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.078551 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.090857 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c6a3ef8f-06e8-4cc2-96fc-e88a806f7733 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1215 microversion: 2.1 time: 0.181197 Nov 02 12:35:33.095628 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6ffc2f03-50da-48de-9260-383b2a84ca99 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.362771 Nov 02 12:35:33.099817 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 88/161] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:33.107873 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 74/162] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1215 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:33.113516 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4f812003-c759-401f-bc73-1bf1e32dc5d4 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.212822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.213403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.220929 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.221577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.222107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.223284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.223962 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.225275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.332855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.360318 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dd8df0c0-ccdf-457e-a789-f6d81722c968 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1274 microversion: 2.1 time: 0.136940 Nov 02 12:35:33.360318 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 75/163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:33.362199 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4f812003-c759-401f-bc73-1bf1e32dc5d4 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.257976 Nov 02 12:35:33.362951 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 89/164] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:33.378745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-63f195bb-06d3-4629-b59c-ec0c2eb3ab3d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2117138049"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:33.390255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-63f195bb-06d3-4629-b59c-ec0c2eb3ab3d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid f307b4a2-34f8-4c7a-b493-3dd18c06b846 for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:33.533258 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-63f195bb-06d3-4629-b59c-ec0c2eb3ab3d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.162540 Nov 02 12:35:33.533964 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 76/165] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:33.553740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-72cfcff5-ed82-4b23-88fa-4874e0617fc9 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:33.584686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-72cfcff5-ed82-4b23-88fa-4874e0617fc9 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.585656 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-72cfcff5-ed82-4b23-88fa-4874e0617fc9 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.586289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-72cfcff5-ed82-4b23-88fa-4874e0617fc9 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.936871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.937654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.951925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.953036 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.955349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.957538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.960958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.961663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.014232 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-72cfcff5-ed82-4b23-88fa-4874e0617fc9 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.464237 Nov 02 12:35:34.016803 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 90/166] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:33 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:34.030274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b042f3e5-78e7-4214-ad4c-8c4a33a92c15 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:34.043713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b042f3e5-78e7-4214-ad4c-8c4a33a92c15 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.044444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b042f3e5-78e7-4214-ad4c-8c4a33a92c15 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.045796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b042f3e5-78e7-4214-ad4c-8c4a33a92c15 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.333183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.347598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-960d29d8-a3c9-4c81-8192-664e27969d32 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.419465 Nov 02 12:35:34.352846 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 77/167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:34.365522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.366586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.375571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.376293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.377004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.377827 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.378987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.380076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.440721 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b042f3e5-78e7-4214-ad4c-8c4a33a92c15 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.416831 Nov 02 12:35:34.445536 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 91/168] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:34 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:34.452657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.474544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.490629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.495398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.496366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.497490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.498228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.498857 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.677140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.687113 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-27e6ccf1-7dd3-48f8-bda0-0f7e996f3f57 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1279 microversion: 2.1 time: 0.331694 Nov 02 12:35:34.689277 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 78/169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1279 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:34.695051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ab7c012-974f-4ca8-af55-51c3c757e4c3 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.725630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:34.739498 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dd063fc9-b1d6-4a69-91b7-db09e6f673f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1272 microversion: 2.1 time: 0.296288 Nov 02 12:35:34.741836 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 92/170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:34.813510 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9ab7c012-974f-4ca8-af55-51c3c757e4c3 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.122195 Nov 02 12:35:34.823136 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 79/171] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:34 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:34.828339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-32c67d1d-5a45-4de6-a7c6-f8513aecec09 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-294071050"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:34.837048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-32c67d1d-5a45-4de6-a7c6-f8513aecec09 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid 5288180e-6a19-4e0c-a200-274a1113b68f for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:34.853236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5d127700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.857294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.858137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.858646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.859717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.860317 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.860837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.875257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=23 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:34.899787 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cca04384-1561-43fe-854b-a6de859efd8e tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.052866 Nov 02 12:35:34.906660 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 80/172] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:34.912377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5d08c4c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.916787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.920434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.920984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.922113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.922643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.923064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.960700 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-32c67d1d-5a45-4de6-a7c6-f8513aecec09 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.136951 Nov 02 12:35:34.963005 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 93/173] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:34 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:34.977173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-72c34968-839a-4bdf-9447-3073902c625d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.981355 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b6a6687f-e95c-48ae-8c41-7c79b6570d59 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.073198 Nov 02 12:35:34.982386 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 81/174] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:34.996695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5dda7040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.005322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.006006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.006594 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.008234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.009012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.009647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.050129 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a90a84d3-f493-4646-9c85-321b4d70194b tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.059776 Nov 02 12:35:35.053686 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 82/175] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:35.070805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb27d79f-d1f7-4bc8-b1cd-7fd631e8605e tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1268256342"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:35.076172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-fb27d79f-d1f7-4bc8-b1cd-7fd631e8605e tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Generated uuid aaf3dc77-dbdf-4eeb-98c8-a1a77ce4070f for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:35.156816 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-72c34968-839a-4bdf-9447-3073902c625d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.187446 Nov 02 12:35:35.158513 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 94/176] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:34 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:35.168962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5d175310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.183712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.184223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.184739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.218527 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb27d79f-d1f7-4bc8-b1cd-7fd631e8605e tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.162644 Nov 02 12:35:35.219770 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 83/177] 10.222.0.64 () {62 vars in 1205 bytes} [Wed Nov 2 12:35:35 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:35.227536 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cb5ef907-acc0-4972-a669-a0bf614e4a3a tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.228137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.228687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.229134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.240702 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-cb5ef907-acc0-4972-a669-a0bf614e4a3a tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cb5ef907-acc0-4972-a669-a0bf614e4a3a tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Request method failure captured: Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPnwSkOR8GMjwBDntWsDP9ziulVEfsCJ1eDGaZamlk-AWxE9PZ5zfrQVKNIKaqSc_ON_yP7Npgqd13f1PFuc0z5w4jcJx0fTudUAPs3HEqPj8pLV1Y9xhn-38r5SqwdiOqG-gZg1iIfG2TBkJ4d2kzcdLxB3yRRI29ai2vvUmLhX-U Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:35.252360 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da4a89bac5d84ce9a561087ded7b5a28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}] Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9a4a4a42922f4f5fa91e71cc8030f318 Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: exception: Aggregate 5 could not be found. Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '5'} Nov 02 12:35:35.254012 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.254739 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 02 12:35:35.256806 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.260422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cb5ef907-acc0-4972-a669-a0bf614e4a3a tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:35.262607 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cb5ef907-acc0-4972-a669-a0bf614e4a3a tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041046 Nov 02 12:35:35.263979 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 84/178] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:35.268752 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82587ebd-1272-4434-9026-bd1b4ba02b72 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-h2-857339-6" status: 200 len: 598 microversion: 2.1 time: 0.108870 Nov 02 12:35:35.269705 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 95/179] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/os-hosts/n-h2-857339-6 => generated 598 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:35.276756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-341cd7b8-e38d-4563-b56b-acbcac17c468 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-229352224"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:35.284183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f38d9239-c1f3-43cb-a1e6-7050ede5427d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.307900 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-f38d9239-c1f3-43cb-a1e6-7050ede5427d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f38d9239-c1f3-43cb-a1e6-7050ede5427d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Request method failure captured: Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPnwSkOR8GMjwBDntWsDP9ziulVEfsCJ1eDGaZamlk-AWxE9PZ5zfrQVKNIKaqSc_ON_yP7Npgqd13f1PFuc0z5w4jcJx0fTudUAPs3HEqPj8pLV1Y9xhn-38r5SqwdiOqG-gZg1iIfG2TBkJ4d2kzcdLxB3yRRI29ai2vvUmLhX-U Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:35:35.313192 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da4a89bac5d84ce9a561087ded7b5a28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}] Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9a4a4a42922f4f5fa91e71cc8030f318 Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: exception: Aggregate 5 could not be found. Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '5'} Nov 02 12:35:35.314650 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:35.315729 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:35.317472 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:35.318907 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f38d9239-c1f3-43cb-a1e6-7050ede5427d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:35.319963 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f38d9239-c1f3-43cb-a1e6-7050ede5427d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.046307 Nov 02 12:35:35.325422 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 96/180] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:35 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:35.326433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Calling method '.version_select at 0x7eff5cf904c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.335170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.335670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.336390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.355458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=8,nova_api:DELETE=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:35.359995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.360631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.361150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.412439 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-95338895-e03e-4721-9d81-1e4f802098e8 tempest-HostsAdminTestJSON-895459402 tempest-HostsAdminTestJSON-895459402-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-h1-857339-6" status: 200 len: 598 microversion: 2.1 time: 0.089997 Nov 02 12:35:35.414647 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 97/181] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/os-hosts/n-h1-857339-6 => generated 598 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:35.436364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-590ac54e-2b79-428d-a590-e5f614ab38cb tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-879918893", "name": "tempest-test_aggregate-1935038261"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:35.459823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-590ac54e-2b79-428d-a590-e5f614ab38cb tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid 9667da2d-bcd6-4064-94e9-e693c640c2af for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:35.491145 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-341cd7b8-e38d-4563-b56b-acbcac17c468 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.225743 Nov 02 12:35:35.491813 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 85/182] 10.222.0.64 () {62 vars in 1210 bytes} [Wed Nov 2 12:35:35 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:35.497411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.505315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:35.527771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.527910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.535117 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.536174 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.539274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.540043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.664565 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-590ac54e-2b79-428d-a590-e5f614ab38cb tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.247572 Nov 02 12:35:35.665841 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 98/183] 10.222.0.64 () {60 vars in 1165 bytes} [Wed Nov 2 12:35:35 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:35.672916 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-197d500b-38c0-465b-98a9-0cdc5a9bb0ff tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.700117 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-197d500b-38c0-465b-98a9-0cdc5a9bb0ff tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.032381 Nov 02 12:35:35.706229 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 99/184] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:35.714051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5b8879c2-4c61-4273-9724-453eda212b08 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.846937 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5b8879c2-4c61-4273-9724-453eda212b08 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.137458 Nov 02 12:35:35.847538 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 100/185] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:35 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:35.857008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:35.859122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:35.867241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.867945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.868630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:35.869569 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:35.870242 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:35.871188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.075227 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.086878 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bf1aebd5-8abd-49e3-b32b-1f2e14814271 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1277 microversion: 2.1 time: 0.234428 Nov 02 12:35:36.090301 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 101/186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:36.106349 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d7efb2bc-4077-4493-a786-e1f5fa550a54 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:36.147928 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7efb2bc-4077-4493-a786-e1f5fa550a54 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.148881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7efb2bc-4077-4493-a786-e1f5fa550a54 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.150132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7efb2bc-4077-4493-a786-e1f5fa550a54 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.206312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.210609 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:36.225366 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1f96b6b5-cc99-41c7-bc8a-078efa1be7b5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.722684 Nov 02 12:35:36.234061 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 86/187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:35 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:36.261087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:36.264219 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:36.272198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.273057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.273709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.274559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.275158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.275757 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.317506 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:36.686699 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d7efb2bc-4077-4493-a786-e1f5fa550a54 tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.593097 Nov 02 12:35:36.694299 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 102/188] 10.222.0.64 () {62 vars in 1232 bytes} [Wed Nov 2 12:35:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:36.694299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca78ce66-e9a0-4af9-8d3b-545d1f30d5f2 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:36.723163 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-ca78ce66-e9a0-4af9-8d3b-545d1f30d5f2 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca78ce66-e9a0-4af9-8d3b-545d1f30d5f2 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Request method failure captured: Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPnwSkOR8GMjwBDntWsDP9ziulVEfsCJ1eDGaZamlk-AWxE9PZ5zfrQVKNIKaqSc_ON_yP7Npgqd13f1PFuc0z5w4jcJx0fTudUAPs3HEqPj8pLV1Y9xhn-38r5SqwdiOqG-gZg1iIfG2TBkJ4d2kzcdLxB3yRRI29ai2vvUmLhX-U Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:35:36.725163 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da4a89bac5d84ce9a561087ded7b5a28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}] Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9a4a4a42922f4f5fa91e71cc8030f318 Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: exception: Aggregate 7 could not be found. Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '7'} Nov 02 12:35:36.726349 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:36.727043 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 12:35:36.728179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:36.731719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca78ce66-e9a0-4af9-8d3b-545d1f30d5f2 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:36.732858 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca78ce66-e9a0-4af9-8d3b-545d1f30d5f2 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.044451 Nov 02 12:35:36.735961 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 103/189] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:35:36 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:36.749889 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e207ff97-3541-4f3f-9645-14f27724acbe tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:36.775189 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e207ff97-3541-4f3f-9645-14f27724acbe tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.783072 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e207ff97-3541-4f3f-9645-14f27724acbe tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.785403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e207ff97-3541-4f3f-9645-14f27724acbe tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.948271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.980699 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0b776e20-131f-419b-8ede-17cc52847fd3 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.743501 Nov 02 12:35:36.983822 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 87/190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:36 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:37.021603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e724f3a7-5ea2-48cf-b21e-db664f9b8a9b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-e724f3a7-5ea2-48cf-b21e-db664f9b8a9b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e724f3a7-5ea2-48cf-b21e-db664f9b8a9b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Request method failure captured: Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPnwSkOR8GMjwBDntWsDP9ziulVEfsCJ1eDGaZamlk-AWxE9PZ5zfrQVKNIKaqSc_ON_yP7Npgqd13f1PFuc0z5w4jcJx0fTudUAPs3HEqPj8pLV1Y9xhn-38r5SqwdiOqG-gZg1iIfG2TBkJ4d2kzcdLxB3yRRI29ai2vvUmLhX-U Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:37.078712 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_da4a89bac5d84ce9a561087ded7b5a28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/da4a89bac5d84ce9a561087ded7b5a28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/da4a89bac5d84ce9a561087ded7b5a28"}]}] Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: da4a89bac5d84ce9a561087ded7b5a28 Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1681955242 Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9a4a4a42922f4f5fa91e71cc8030f318 Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminTestJSON-1681955242-project-admin Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: exception: Aggregate 7 could not be found. Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '7'} Nov 02 12:35:37.080338 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:37.091056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:37.092851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e724f3a7-5ea2-48cf-b21e-db664f9b8a9b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e724f3a7-5ea2-48cf-b21e-db664f9b8a9b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.067392 Nov 02 12:35:37.093952 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 88/191] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:36 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:37.261762 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1083774954", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:37.641955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] validate_networks() for [('6f31d9b0-b528-42bc-93ab-d8c292b878da', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:37.679591 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e207ff97-3541-4f3f-9645-14f27724acbe tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.941898 Nov 02 12:35:37.694012 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 104/192] 10.222.0.64 () {62 vars in 1232 bytes} [Wed Nov 2 12:35:36 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:35:37.694012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c3b52f6c-4940-4277-aa07-9e91f426c16b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-844475250"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:37.694012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-c3b52f6c-4940-4277-aa07-9e91f426c16b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid 8059d3fc-e4c1-40ee-93b5-8d420767f08d for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:37.800423 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c3b52f6c-4940-4277-aa07-9e91f426c16b tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.116353 Nov 02 12:35:37.802664 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 105/193] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:37 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:37.813099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.816177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.841653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.842172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.842624 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.843356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.843815 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.844243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114) Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:38.196747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.197948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:38.199583 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:38.200771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:38.203016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114) Nov 02 12:35:38.203016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.206641 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:38.206641 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Request method failure captured: Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 216 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKdqjqhiyGOblrTCk1CkW9W92_s9Beq0Ar670mJIcOFi9zFrUehPLepafMjxpAJe7KMAQQRMi5vicINrCewS1QEi1jaZnR_0RCHd5x29hpBrIkynmS2aGR8RN1piWpQ8ELFMWylFWANa_9w5cdg5uLXi7__opokh0LnVOrPxfl_L0 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:38.211108 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9774a0fd28c545c490450ef89610c63d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}] Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ff76a6cbd0154558a0617fd081412831 Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:38.218769 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1083774954", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}]}} Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-1083774954', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '6f31d9b0-b528-42bc-93ab-d8c292b878da'}]}}} Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:38.219422 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.220532 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:38.221558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:38.222498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-20b9c0ac-cf8f-4ede-a8be-6ed8d6190114) Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:38.223327 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-458a92df-8de8-4aaa-8a96-983d66137b48 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 1.137842 Nov 02 12:35:38.224356 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 89/194] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:35:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 1139 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:35:38.227786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.228790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.237030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.237914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.238761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.239684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.240306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.240915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.316125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.328378 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d593110c-4a3d-4613-97a4-bf86a089e30c tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.522998 Nov 02 12:35:38.329300 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 106/195] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:38.335951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-56fb094f-df4d-4bed-aeb5-4d4edb44bf3b tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.492162 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-56fb094f-df4d-4bed-aeb5-4d4edb44bf3b tempest-AggregatesAdminTestV241-1083152802 tempest-AggregatesAdminTestV241-1083152802-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.159364 Nov 02 12:35:38.496131 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 107/196] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:35:38 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:38.507101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2af4f814-6aa5-4170-9024-0f56c1b76d62 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.529553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.531754 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2af4f814-6aa5-4170-9024-0f56c1b76d62 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.032623 Nov 02 12:35:38.532562 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 108/197] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:38.542677 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-80adce1e-3e81-4df7-9541-e75b467ea3eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.327679 Nov 02 12:35:38.543634 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 90/198] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:38.552103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-560504253", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:38.554060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.554718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.573039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.574257 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.574257 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.575186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.576019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.576629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.676519 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] validate_networks() for [('6f31d9b0-b528-42bc-93ab-d8c292b878da', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:39.267673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:39.318460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.333653 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-15cd6099-3cec-4635-ac87-554a8d0de6ef tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.791895 Nov 02 12:35:39.348643 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 109/199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:39.349590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.351256 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:39.352376 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:39.359737 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15) Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Request method failure captured: Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 215 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKdqjqhiyGOblrTCk1CkW9W92_s9Beq0Ar670mJIcOFi9zFrUehPLepafMjxpAJe7KMAQQRMi5vicINrCewS1QEi1jaZnR_0RCHd5x29hpBrIkynmS2aGR8RN1piWpQ8ELFMWylFWANa_9w5cdg5uLXi7__opokh0LnVOrPxfl_L0 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:39.361304 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9774a0fd28c545c490450ef89610c63d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}] Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ff76a6cbd0154558a0617fd081412831 Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:39.370781 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-560504253", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}]}} Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-560504253', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '6f31d9b0-b528-42bc-93ab-d8c292b878da'}]}}} Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:39.371394 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.372365 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:39.374467 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:39.375670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-592c5b02-a2cf-42bd-a1fb-d88853fa9f15) Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:39.378105 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ba794bbb-6661-42cd-b374-e3ab128f00af tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.808882 Nov 02 12:35:39.381048 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 91/200] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:35:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 819 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:35:39.382643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7c6a67c1-3788-4447-a94f-a0b9a48b4880 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-746656753"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:39.382643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-7c6a67c1-3788-4447-a94f-a0b9a48b4880 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 64d26e5a-f220-4bdc-b706-24c72371fc77 for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:39.382957 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ed2f2cb-d6b8-4c8a-a6fe-2f985f43eef7 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:39.519647 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7c6a67c1-3788-4447-a94f-a0b9a48b4880 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.154838 Nov 02 12:35:39.529092 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 92/201] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:39.536173 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6ed2f2cb-d6b8-4c8a-a6fe-2f985f43eef7 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.199176 Nov 02 12:35:39.537091 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 110/202] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:39.561028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdedb786-7c48-47e9-aa18-220972e9405e", "tag": "a911b949-15e2-47ba-aea9-5c8e8118311c"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:39.561541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.561541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.568180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.568385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.568714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.568925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.569156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.569896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.570347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.571018 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.571765 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.604464 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] Creating event network-changed:a911b949-15e2-47ba-aea9-5c8e8118311c for instance fdedb786-7c48-47e9-aa18-220972e9405e on n-h2-857339-6 Nov 02 12:35:39.613759 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-a93bdb72-46ae-4c41-b116-7cc2846105a0 req-544bf000-fa22-4a41-bca7-a2c98320458d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082432 Nov 02 12:35:39.615602 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 93/203] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:39.623985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66d45349-eac8-45bc-9c50-4f5027e2b63a tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Action: 'create', calling method: .version_select at 0x7eff5e4e58b0>, body: {"keypair": {"name": "tempest-keypair-839367090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB9SnGqYznxw49f6wIH85bliPcjxmHd21tLugt8OfUhPdeJfTw0vzL6YPXrcm8RBg/3khsOJprwM5JuJ+vwooLvhIJ5tOT6unn9A1yG4MXR4BBembcg1iCMG8Oq1mKJCQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:39.640090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:39.658339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-66d45349-eac8-45bc-9c50-4f5027e2b63a tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Getting quotas for project 9774a0fd28c545c490450ef89610c63d. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:39.663227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-66d45349-eac8-45bc-9c50-4f5027e2b63a tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Getting quotas for user ff76a6cbd0154558a0617fd081412831 and project 9774a0fd28c545c490450ef89610c63d. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:39.728521 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66d45349-eac8-45bc-9c50-4f5027e2b63a tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.111496 Nov 02 12:35:39.737803 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 94/204] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:35:39.737803 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-733271d6-a9ed-4c14-b3ac-2ba13e67966e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:39.759751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-733271d6-a9ed-4c14-b3ac-2ba13e67966e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.760257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-733271d6-a9ed-4c14-b3ac-2ba13e67966e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.760729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-733271d6-a9ed-4c14-b3ac-2ba13e67966e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.205527 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-733271d6-a9ed-4c14-b3ac-2ba13e67966e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.475341 Nov 02 12:35:40.206990 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 95/205] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:39 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:40.212772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-84e717b2-73f2-4c9b-94c3-e84cc184880d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.223392 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-84e717b2-73f2-4c9b-94c3-e84cc184880d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.015040 Nov 02 12:35:40.231713 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 96/206] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:40.237886 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.239061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.246821 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.248307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.257072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.257986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.258730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.259377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.585686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.596334 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82f76ddd-7822-414d-889e-16529e0bce93 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 1.057854 Nov 02 12:35:40.604929 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 111/207] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:40.626222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "770566dc-692d-4e7a-ad96-d33a9c01be92", "tag": "0b5c2458-e96d-4ef7-91f3-71586f8654af"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:40.642346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.644175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.645570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.669316 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] Creating event network-changed:0b5c2458-e96d-4ef7-91f3-71586f8654af for instance 770566dc-692d-4e7a-ad96-d33a9c01be92 on n-h2-857339-6 Nov 02 12:35:40.676156 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-59c1291e-58c1-4bc7-9097-fcf5a1d5cbe2 req-277a1944-1f95-4996-8d99-7a4c432ffe5c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067199 Nov 02 12:35:40.677161 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 112/208] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:40.683915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:40.724091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.726029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.726984 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.805902 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Aggregate 9 already has host n-h2-857339-6. Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 39 Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:35:40.836883 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: {"add_host": {"host": "n-h2-857339-6"}} Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:40.839774 n-d-857339-6 devstack@n-api.service[127767]: exception: Aggregate 9 already has host n-h2-857339-6. Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '9', 'body': {'add_host': {'host': 'n-h2-857339-6'}}} Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:35:40.841461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-857339-6-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:35:40.843985 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:35:40.847766 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:35:40.850277 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-857339-6-9' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 35, 40, 758012), 'updated_at': None, 'host': 'n-h2-857339-6', 'aggregate_id': 9}] Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:40.852680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 9 already has host n-h2-857339-6. Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.863171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 9 already has host n-h2-857339-6. Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:40.866031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 9 already has host n-h2-857339-6. Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 409 to user: Aggregate 9 already has host n-h2-857339-6. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a56d2d29-93af-4cdd-a416-d7a053f836e6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/9/action" status: 409 len: 95 microversion: 2.1 time: 0.159991 Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 113/209] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:40 2022] POST /compute/v2.1/os-aggregates/9/action => generated 95 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Nov 02 12:35:40.869848 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c489664-9cb6-43c1-816d-56f25991c314 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.981362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=16 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:41.012615 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c489664-9cb6-43c1-816d-56f25991c314 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.170802 Nov 02 12:35:41.021043 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 114/210] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:40 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:41.026286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:41.027236 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:41.065012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.065549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.066003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.068003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.068555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.069004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.217616 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.226440 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d54579db-3203-4e19-8d37-59e51a12e750 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.993093 Nov 02 12:35:41.227140 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 97/211] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:41.249992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-caf006ad-2e31-410d-b2dd-f0ab6db229ff tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:41.263411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caf006ad-2e31-410d-b2dd-f0ab6db229ff tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.264138 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caf006ad-2e31-410d-b2dd-f0ab6db229ff tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.264641 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-caf006ad-2e31-410d-b2dd-f0ab6db229ff tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.505158 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.513266 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5b076c28-3b7f-4647-83fc-b8aaad39d4a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.490752 Nov 02 12:35:41.513864 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 115/212] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:41 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:41.518891 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f4ac2876-2f4e-45cc-96cf-a10c3e3d75b3 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-804904009", "availability_zone": "tempest-test_az-78523442"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:41.523277 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-f4ac2876-2f4e-45cc-96cf-a10c3e3d75b3 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid be417d80-f69d-413c-b28c-6906237a3a54 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:41.782076 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-caf006ad-2e31-410d-b2dd-f0ab6db229ff tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.538774 Nov 02 12:35:41.782700 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 98/213] 10.222.0.64 () {60 vars in 1191 bytes} [Wed Nov 2 12:35:41 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:41.793004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:41.793004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:41.798096 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f4ac2876-2f4e-45cc-96cf-a10c3e3d75b3 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.262224 Nov 02 12:35:41.801276 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 116/214] 10.222.0.64 () {60 vars in 1165 bytes} [Wed Nov 2 12:35:41 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:41.803163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.803672 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.807849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.808651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.809129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.809561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.831713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b675eccd-9fed-4d65-b56b-80a0f46b523f", "tag": "df5c0c04-c31c-4b89-89ec-fb14f2763e26"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:41.879259 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.881036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.883817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.908401 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] Creating event network-changed:df5c0c04-c31c-4b89-89ec-fb14f2763e26 for instance b675eccd-9fed-4d65-b56b-80a0f46b523f on n-h1-857339-6 Nov 02 12:35:41.916842 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-ff6a273f-5aa5-46da-971e-088ffe8fdaf4 req-5ce01086-1097-45e0-bdc6-e91e2ac62204 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113167 Nov 02 12:35:41.917976 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 117/215] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:41.929649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-492d0668-4687-4b00-9799-54a5b38c0f0f tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.013847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.021894 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2b65bca4-6114-42e9-9d19-7efac10186d4 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.238138 Nov 02 12:35:42.022475 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 99/216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:41 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:42.026802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-45707d2b-f1a0-471e-aafe-7f59442e6a1d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-804904009_new", "availability_zone": "tempest-test_az-78523442_new"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.101520 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-492d0668-4687-4b00-9799-54a5b38c0f0f tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.180335 Nov 02 12:35:42.102356 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 118/217] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:41 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:42.112504 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac3b212d-5beb-449e-8fc2-41866fc3ca0d tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1739993612"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.115922 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-ac3b212d-5beb-449e-8fc2-41866fc3ca0d tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid b4ca2a4a-a357-49ba-b7f7-4224fa187483 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:42.248324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-45707d2b-f1a0-471e-aafe-7f59442e6a1d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.249054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-45707d2b-f1a0-471e-aafe-7f59442e6a1d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.249498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-45707d2b-f1a0-471e-aafe-7f59442e6a1d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.296416 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ac3b212d-5beb-449e-8fc2-41866fc3ca0d tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.188283 Nov 02 12:35:42.299322 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 119/218] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:42.303281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.304376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:42.312179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.312726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.313150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.313846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.314320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.314736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.403990 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-45707d2b-f1a0-471e-aafe-7f59442e6a1d tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 332 microversion: 2.1 time: 0.380423 Nov 02 12:35:42.404716 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 100/219] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 12:35:42 2022] PUT /compute/v2.1/os-aggregates/10 => generated 332 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:42.556222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.565610 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-60b149cc-ae6f-47be-9864-40d1eb8a24e1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.266499 Nov 02 12:35:42.566276 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 120/220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:42.574610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ea081c6-d72f-4a2b-9698-4362443fc320 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.583553 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1ea081c6-d72f-4a2b-9698-4362443fc320 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 200 len: 550 microversion: 2.1 time: 0.016196 Nov 02 12:35:42.584477 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 121/221] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/os-aggregates => generated 550 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:42.592879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.594173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:42.599905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.600373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.600831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.601539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.601989 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.602415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.739015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c739be2b-4548-4eb1-83e7-2fe450a058d0 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.745357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c739be2b-4548-4eb1-83e7-2fe450a058d0 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c739be2b-4548-4eb1-83e7-2fe450a058d0 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 39 Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:42.748787 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: {"add_host": {"host": "n-h2-857339-6"}} Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:42.751315 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-857339-6'}}} Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:42.761173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Nov 02 12:35:42.765072 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:42.767358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c739be2b-4548-4eb1-83e7-2fe450a058d0 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:42.767358 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c739be2b-4548-4eb1-83e7-2fe450a058d0 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "POST /compute/v2.1/os-aggregates/11/action" status: 403 len: 118 microversion: 2.1 time: 0.349674 Nov 02 12:35:42.767358 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 101/222] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-aggregates/11/action => generated 118 bytes in 352 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:42.773368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bb0f7eb5-3c3d-44d3-bd58-8c0382c5b069 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.812918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.827985 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-24926462-61ec-4660-b337-745f8918ffcb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.241623 Nov 02 12:35:42.829252 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 122/223] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:42.838025 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-49fd68d5-4992-425a-9c5c-78c41fd7cfeb tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.849070 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=9 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:42.896597 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bb0f7eb5-3c3d-44d3-bd58-8c0382c5b069 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.137628 Nov 02 12:35:42.898601 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 102/224] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:42 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:42.907970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.933127 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-49fd68d5-4992-425a-9c5c-78c41fd7cfeb tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.094504 Nov 02 12:35:42.933306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.933306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.933441 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 123/225] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:42 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:42.934300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.936419 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-404acffc-8a48-4e8b-a09d-5bd7eb14e5bd tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-731771179"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.940410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-404acffc-8a48-4e8b-a09d-5bd7eb14e5bd tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Generated uuid bb4bb798-4ee7-4ca9-b1b8-612f2206133d for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:42.952678 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] Creating event network-changed:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:35:42.959598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-1a1e3c49-97b0-45a5-a354-c84cbd186412 req-a11b8b9d-79cb-4477-b786-07caf3cde9e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060883 Nov 02 12:35:42.961467 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 103/226] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:42.966813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a1cbfe07-249f-40d2-8dab-d53a83905e2a tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2085841039"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.971081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-a1cbfe07-249f-40d2-8dab-d53a83905e2a tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 0640849f-de9e-44bf-942f-b1ea91e8f03f for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:43.034041 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-404acffc-8a48-4e8b-a09d-5bd7eb14e5bd tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.106547 Nov 02 12:35:43.036046 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 124/227] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:43.045710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.046619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.058585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.058585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.058585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.059236 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.060449 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.061239 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.069324 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a1cbfe07-249f-40d2-8dab-d53a83905e2a tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.106560 Nov 02 12:35:43.072860 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 104/228] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:43.083910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b0d060e8-c19b-4e03-b99c-6904dfeaddd1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.101343 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b0d060e8-c19b-4e03-b99c-6904dfeaddd1 tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.027227 Nov 02 12:35:43.110084 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 105/229] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:43.115213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1062665334"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.127729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.128289 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.128827 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.139308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.140233 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.140911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.150066 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1062665334 could not be found. Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 58 Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:43.153185 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: {"add_host": {"host": "tempest-nonexist_host-1062665334"}} Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:43.154716 n-d-857339-6 devstack@n-api.service[127766]: exception: Compute host tempest-nonexist_host-1062665334 could not be found. Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1062665334'}}} Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1062665334' is not mapped to any cell Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.155573 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Nov 02 12:35:43.157081 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1062665334 could not be found. Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1062665334 could not be found. Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.158502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1062665334 could not be found. Nov 02 12:35:43.160113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.161348 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1062665334 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.168645 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e89eeed2-fce1-4de5-9fe0-404da1e9bc4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.053062 Nov 02 12:35:43.168645 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 106/230] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:43.169777 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79fa3fa9-eb0f-44b8-bcf8-88e35c2a85ea tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.289924 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-79fa3fa9-eb0f-44b8-bcf8-88e35c2a85ea tempest-AggregatesAdminTestJSON-1681955242 tempest-AggregatesAdminTestJSON-1681955242-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.125332 Nov 02 12:35:43.295878 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 107/231] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:43 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:43.301450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8aa8928d-2a0f-49d5-9915-6bd1bb5fa103 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.374559 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.398343 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-23df1b29-e4ee-45a6-912f-c5077f1ef862 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.356729 Nov 02 12:35:43.403931 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 125/232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:43.413738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.414339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.429147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.429411 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8aa8928d-2a0f-49d5-9915-6bd1bb5fa103 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.131405 Nov 02 12:35:43.429989 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.430488 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 108/233] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:43 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:43.443936 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.443936 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.443936 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.443936 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.446050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76c2a306-dae3-4337-ae5e-43593043ec9e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.452787 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] HTTP exception thrown: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Request method failure captured: Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 HTTP/1.1 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPj5lRVoqGjmfS4FWNmrTb4kcGXUIwhialrfr-GCT6WqYEy731o0hY4yiVXi5hHQ9l60WyfFZeVkAW1JmeMXJ-trkK4DnlZz2xzTJM0u5Wrj-nqMx5n_QgoCJbtQp-Z2xxdjPKdaSZbTo2HsyotbT07H3tsiX-XxMEWVff5egGw7g4 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:43.455268 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1dbe11c2ed6c436caf0eb7c8da9beed5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}] Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: f441720944f34d6dad78783005fa6165 Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.456754 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1fa188d9-0f74-4d89-891c-3622a0f51fd9'} Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.457561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.460178 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76c2a306-dae3-4337-ae5e-43593043ec9e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 283 Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:43.464783 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.466297 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:35:43.466994 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.467609 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.469797 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.470809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:35:43.470809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:35:43.470809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Nov 02 12:35:43.470809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.474081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76c2a306-dae3-4337-ae5e-43593043ec9e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.476296 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-76c2a306-dae3-4337-ae5e-43593043ec9e tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035751 Nov 02 12:35:43.477188 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 109/234] 10.222.0.64 () {60 vars in 1165 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:35:43.478241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Returning 404 to user: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.479868 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dbe7c8df-c220-4d2b-833c-e8d25030fb34 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 404 len: 111 microversion: 2.1 time: 0.078661 Nov 02 12:35:43.489770 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 126/235] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:43 2022] DELETE /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:43.494160 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d70a2490-f166-4e4a-a058-ef6f7f31fde0 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.502243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.503109 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] [instance: 1fa188d9-0f74-4d89-891c-3622a0f51fd9] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d70a2490-f166-4e4a-a058-ef6f7f31fde0 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 27 Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:43.503636 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: {"aggregate": {"name": ""}} Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:43.504901 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'aggregate': {'name': ''}}} Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi '' Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.505747 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:35:43.507733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.512777 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d70a2490-f166-4e4a-a058-ef6f7f31fde0 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.522797 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d70a2490-f166-4e4a-a058-ef6f7f31fde0 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.027875 Nov 02 12:35:43.522797 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 110/236] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:35:43.523103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.523103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.523657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.524785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.525456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.532396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ea81f9b5-56b2-4f30-b44d-3a55863642f2 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-74481620"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.536204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.536998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ea81f9b5-56b2-4f30-b44d-3a55863642f2 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ea81f9b5-56b2-4f30-b44d-3a55863642f2 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 58 Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:43.539465 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: {"aggregate": {"name": "tempest-test_aggregate-74481620"}} Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:43.541181 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-74481620'}}} Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:43.542068 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:43.543259 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Nov 02 12:35:43.545347 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.546994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ea81f9b5-56b2-4f30-b44d-3a55863642f2 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.548819 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ea81f9b5-56b2-4f30-b44d-3a55863642f2 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.020602 Nov 02 12:35:43.551133 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 111/237] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:43.554161 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] HTTP exception thrown: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Request method failure captured: Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 HTTP/1.1 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPj5lRVoqGjmfS4FWNmrTb4kcGXUIwhialrfr-GCT6WqYEy731o0hY4yiVXi5hHQ9l60WyfFZeVkAW1JmeMXJ-trkK4DnlZz2xzTJM0u5Wrj-nqMx5n_QgoCJbtQp-Z2xxdjPKdaSZbTo2HsyotbT07H3tsiX-XxMEWVff5egGw7g4 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:43.557071 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1dbe11c2ed6c436caf0eb7c8da9beed5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1dbe11c2ed6c436caf0eb7c8da9beed5"}]}] Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 1dbe11c2ed6c436caf0eb7c8da9beed5 Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-310205675 Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: f441720944f34d6dad78783005fa6165 Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminTestJSON-310205675-project Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.558614 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1fa188d9-0f74-4d89-891c-3622a0f51fd9'} Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.559384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. Nov 02 12:35:43.561347 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.563440 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] Returning 404 to user: Instance 1fa188d9-0f74-4d89-891c-3622a0f51fd9 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.564928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5114e821-9a68-453b-872c-1997cac9f075 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541139135"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.565515 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5dac4af1-f20f-46fb-a45e-9d237e8edd30 tempest-AggregatesAdminTestJSON-310205675 tempest-AggregatesAdminTestJSON-310205675-project] 10.222.0.64 "GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9" status: 404 len: 111 microversion: 2.1 time: 0.074393 Nov 02 12:35:43.569897 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 127/238] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/1fa188d9-0f74-4d89-891c-3622a0f51fd9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:43.573627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-5114e821-9a68-453b-872c-1997cac9f075 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 2bb36454-97f4-4639-b690-aa0c9fed8aa2 for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:43.590252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.590975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.606361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.607411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.616281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.616281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.616281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.616281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.760574 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5114e821-9a68-453b-872c-1997cac9f075 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.202943 Nov 02 12:35:43.772341 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 112/239] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:43.798439 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-541139135"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:43.806620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 503df93d-7143-4fcd-8484-3e693ba34a8a for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:43.822534 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-541139135 already exists. Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 59 Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:43.825863 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: {"aggregate": {"name": "tempest-test_aggregate-541139135"}} Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:43.830581 n-d-857339-6 devstack@n-api.service[127766]: exception: Aggregate tempest-test_aggregate-541139135 already exists. Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-541139135'}}} Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate.create() Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Nov 02 12:35:43.831274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-541139135 already exists. Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:43.832553 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-541139135 already exists. Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-541139135 already exists. Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-541139135 already exists. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:43.833652 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e1a592d2-9b8b-4daa-bc23-367cecfdd8e5 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.038883 Nov 02 12:35:43.834402 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 113/240] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:43 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:43.842685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-49436f3b-b61f-4f03-9a58-d5f5602aceb3 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.924661 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-49436f3b-b61f-4f03-9a58-d5f5602aceb3 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.088206 Nov 02 12:35:43.925500 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 114/241] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:43 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:43.930280 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.931037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.946898 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.947725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.947999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.948833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.949848 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.950130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.008301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.017874 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e124f659-3457-420d-9752-6c6444c61888 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.431695 Nov 02 12:35:44.024908 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 128/242] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:44.033067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-51f14f02-fa23-438c-a66b-0b1688438460 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1170112453"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:44.037203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-51f14f02-fa23-438c-a66b-0b1688438460 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 2983d56c-0f16-41d1-bd74-0d717c6bc6a0 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:44.147231 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-51f14f02-fa23-438c-a66b-0b1688438460 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.120897 Nov 02 12:35:44.148646 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 129/243] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:44 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:44.159657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dcedb2ac-8af1-4e21-87d9-799e16298690 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.161584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dcedb2ac-8af1-4e21-87d9-799e16298690 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dcedb2ac-8af1-4e21-87d9-799e16298690 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:44.163406 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:35:44.164610 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '15'} Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:44.165438 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Nov 02 12:35:44.166426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.169585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dcedb2ac-8af1-4e21-87d9-799e16298690 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:44.174327 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dcedb2ac-8af1-4e21-87d9-799e16298690 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.018429 Nov 02 12:35:44.175500 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 130/244] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:44 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:35:44.183584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-90aa67e3-6614-4e23-96c6-ab4a566cae26 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.308229 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-90aa67e3-6614-4e23-96c6-ab4a566cae26 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.123864 Nov 02 12:35:44.313808 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 131/245] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:44 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Nov 02 12:35:44.328285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87e6b830-4e9d-4f71-afe8-330d64581e4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.344218 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-87e6b830-4e9d-4f71-afe8-330d64581e4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87e6b830-4e9d-4f71-afe8-330d64581e4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:35:44.346674 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: exception: Aggregate -1 could not be found. Nov 02 12:35:44.348166 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '-1'} Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:44.348891 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.349978 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 12:35:44.351068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.353698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87e6b830-4e9d-4f71-afe8-330d64581e4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:44.354801 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-87e6b830-4e9d-4f71-afe8-330d64581e4c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032970 Nov 02 12:35:44.356099 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 132/246] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:44 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:44.366791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0da21ad7-f9c0-4bb5-b5dc-5c8bcbe8dacc tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-337908468"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:44.374967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-0da21ad7-f9c0-4bb5-b5dc-5c8bcbe8dacc tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid d35f35c1-d36e-4100-81c6-e19486369a62 for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:44.483942 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0da21ad7-f9c0-4bb5-b5dc-5c8bcbe8dacc tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.120854 Nov 02 12:35:44.485219 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 133/247] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:44.491716 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.492667 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:44.503379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.504054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.504529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.505454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.506064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.506677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.729932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.742262 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b89efb32-a5f7-41c1-bca8-1fca0230ddbb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.815667 Nov 02 12:35:44.744313 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 115/248] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:44.751211 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e3ab7a0-b266-4ecc-a3f2-262354b7b26c tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.752938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9e3ab7a0-b266-4ecc-a3f2-262354b7b26c tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e3ab7a0-b266-4ecc-a3f2-262354b7b26c tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:44.754874 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:35:44.755983 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '16'} Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:44.756657 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Nov 02 12:35:44.757633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.760051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e3ab7a0-b266-4ecc-a3f2-262354b7b26c tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:44.770288 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9e3ab7a0-b266-4ecc-a3f2-262354b7b26c tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.016633 Nov 02 12:35:44.770288 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 116/249] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:44.781307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-28b8a53f-d720-41e3-a493-67eb6db21e1c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.923530 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-28b8a53f-d720-41e3-a493-67eb6db21e1c tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.146450 Nov 02 12:35:44.924713 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 117/250] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:44 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:44.933899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-34d768ad-f26d-42d0-a651-a3713ae00859 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.941969 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-34d768ad-f26d-42d0-a651-a3713ae00859 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-34d768ad-f26d-42d0-a651-a3713ae00859 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:44.944380 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: exception: Aggregate -1 could not be found. Nov 02 12:35:44.945865 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '-1'} Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.946696 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Nov 02 12:35:44.948059 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.951269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-34d768ad-f26d-42d0-a651-a3713ae00859 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:44.951269 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-34d768ad-f26d-42d0-a651-a3713ae00859 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.019659 Nov 02 12:35:44.951509 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 118/251] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:44.961078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5ba5e54a-16d4-467a-86de-a37fd42a5852 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.963097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5ba5e54a-16d4-467a-86de-a37fd42a5852 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5ba5e54a-16d4-467a-86de-a37fd42a5852 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:44.964869 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:35:44.966676 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:44.967330 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:44.968351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5ba5e54a-16d4-467a-86de-a37fd42a5852 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:44.973977 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5ba5e54a-16d4-467a-86de-a37fd42a5852 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.009058 Nov 02 12:35:44.973977 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 119/252] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:44.980075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-27707ce0-7ada-4aa2-a00b-004b1c2e1ea6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-987192826"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:44.983917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-27707ce0-7ada-4aa2-a00b-004b1c2e1ea6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 206c0682-44cc-4963-8e93-c8241d81aa14 for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:45.037295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.053037 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4ef87937-46ec-479c-9399-0f8d63032aad tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.566432 Nov 02 12:35:45.054416 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 134/253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:45.065183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:45.065813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.074655 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.075963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.076619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.077492 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.088619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.088619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.194020 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-27707ce0-7ada-4aa2-a00b-004b1c2e1ea6 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.218949 Nov 02 12:35:45.195602 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 120/254] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:44 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:45.204810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-353654887", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}], "security_groups": [{"name": "tempest-securitygroup--1520102645"}], "key_name": "tempest-keypair-839367090", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.281051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.297800 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-80ea827a-f5cf-4094-b6cc-6b32b1af3f39 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.236322 Nov 02 12:35:45.297800 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 135/255] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:45 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:45.308551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f0bb8e96-11c4-43c8-8679-200c95b82b95 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.337365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f0bb8e96-11c4-43c8-8679-200c95b82b95 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.337365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f0bb8e96-11c4-43c8-8679-200c95b82b95 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.337365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f0bb8e96-11c4-43c8-8679-200c95b82b95 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.425503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] validate_networks() for [('6f31d9b0-b528-42bc-93ab-d8c292b878da', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c2b35b77-3f8f-4186-92f7-679f1ce2702c) Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:45.755137 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.777896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:45.781691 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:45.783621 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:45.786112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c2b35b77-3f8f-4186-92f7-679f1ce2702c) Nov 02 12:35:45.786112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.786112 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:45.786112 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:45.786539 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f0bb8e96-11c4-43c8-8679-200c95b82b95 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.462953 Nov 02 12:35:45.786539 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 136/256] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Request method failure captured: Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 469 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKdqjqhiyGOblrTCk1CkW9W92_s9Beq0Ar670mJIcOFi9zFrUehPLepafMjxpAJe7KMAQQRMi5vicINrCewS1QEi1jaZnR_0RCHd5x29hpBrIkynmS2aGR8RN1piWpQ8ELFMWylFWANa_9w5cdg5uLXi7__opokh0LnVOrPxfl_L0 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:45.786790 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9774a0fd28c545c490450ef89610c63d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}] Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ff76a6cbd0154558a0617fd081412831 Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:35:45.792862 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-353654887", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}], "security_groups": [{"name": "tempest-securitygroup--1520102645"}], "key_name": "tempest-keypair-839367090", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-353654887', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '6f31d9b0-b528-42bc-93ab-d8c292b878da'}], 'security_groups': [{'name': 'tempest-securitygroup--1520102645'}], 'key_name': 'tempest-keypair-839367090', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.794594 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:45.796150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:45.798598 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:45.800620 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c2b35b77-3f8f-4186-92f7-679f1ce2702c) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:35:45.802966 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:45.804887 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:45.806740 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f6ccdc2b-4d72-4f1e-a3c8-2445019fbaa5 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.568286 Nov 02 12:35:45.806740 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 121/257] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 569 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:35:45.806979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:45.806979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.806979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.806979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.807679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.807679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.807679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.807679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.808153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-17a3b495-ddf8-40d6-a1ba-0a7b2a7f5d57 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.816661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-17a3b495-ddf8-40d6-a1ba-0a7b2a7f5d57 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0e480db9b2d24e24aca55712f935edb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8af2442a3c354aaf9656274f1411489a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-17a3b495-ddf8-40d6-a1ba-0a7b2a7f5d57 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Request method failure captured: Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 42 Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPkEVp0MF1ekRsDqPvONdrAVfmlPXP5XIOXZgcLnmPop7TSW9-Zwwhi7h9XJ2rqLDS29tPi44ydfWJy8VYeInrNe-fEMZjYD_i1t14KrPp3i6k9uoww0uexY4OYbgjG3ItUrZjh6h2G3jP8IH374wiPCRsDCOB65o7pqdWkv8PnNpE Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:35:45.818465 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8af2442a3c354aaf9656274f1411489a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8af2442a3c354aaf9656274f1411489a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8af2442a3c354aaf9656274f1411489a"}]}] Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8af2442a3c354aaf9656274f1411489a Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314 Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0e480db9b2d24e24aca55712f935edb9 Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1186819314-project Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: {"remove_host": {"host": "n-h2-857339-6"}} Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:45.831340 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-857339-6'}}} Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:45.834055 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Nov 02 12:35:45.836238 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:45.838998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-17a3b495-ddf8-40d6-a1ba-0a7b2a7f5d57 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:45.838998 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-17a3b495-ddf8-40d6-a1ba-0a7b2a7f5d57 tempest-AggregatesAdminNegativeTestJSON-1186819314 tempest-AggregatesAdminNegativeTestJSON-1186819314-project] 10.222.0.64 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.026265 Nov 02 12:35:45.838998 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 122/258] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:45.860167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-59053147-0220-4f6f-8010-eff1b6effb20 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:45.891550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59053147-0220-4f6f-8010-eff1b6effb20 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.892913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59053147-0220-4f6f-8010-eff1b6effb20 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.902448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59053147-0220-4f6f-8010-eff1b6effb20 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.914376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:UPDATE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:46.110971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.119730 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6c690097-057d-4d38-8cf5-6ade8791f152 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.357547 Nov 02 12:35:46.134263 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 137/259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:45 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:46.207270 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-59053147-0220-4f6f-8010-eff1b6effb20 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.377167 Nov 02 12:35:46.216556 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 123/260] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:45 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:46.223913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.224753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:46.252334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.254258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.256151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.259698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.261050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.262037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.586060 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.598881 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-395fdf10-df31-403a-8d23-a6d852deb13e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.380226 Nov 02 12:35:46.614315 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 124/261] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:46.626344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9a962c07-521c-402a-a2e3-97f7eb785eeb tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.727641 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9a962c07-521c-402a-a2e3-97f7eb785eeb tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.111691 Nov 02 12:35:46.728164 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 125/262] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:46 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:46.742346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.744634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:46.765039 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.765831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.769498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.772052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.773805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.775895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.972721 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Calling method '.version_select at 0x7eff5ccea790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.975830 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.976626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.977073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.995069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.995856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.996796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.015976 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.016762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.017409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.029917 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c50cd40c-085f-4df2-a1b0-9ea6f2c1fcc3 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.891743 Nov 02 12:35:47.037989 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 138/263] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:47.043404 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c7524a29-7a0b-4fe7-9eed-70e4d4dfcb5b tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-587210282"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:47.044614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.047985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.aggregate [None req-c7524a29-7a0b-4fe7-9eed-70e4d4dfcb5b tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Generated uuid 3936124d-777f-4ce3-a995-2335c73b098b for aggregate {{(pid=127767) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 12:35:47.053524 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c632edc9-1b5a-4fdc-ac4e-1e471902304e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.324078 Nov 02 12:35:47.054118 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 126/264] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.063791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Calling method '.version_select at 0x7eff5e4e58b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.075024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.076687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.077109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.090262 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.091537 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.092183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.117961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.118460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.118901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.125277 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-60e0d9fd-6b91-4de2-a69b-571a48e93847 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/n-h2-857339-6/servers" status: 200 len: 275 microversion: 2.1 time: 0.065095 Nov 02 12:35:47.125861 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 127/265] 10.222.0.64 () {58 vars in 1212 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/os-hypervisors/n-h2-857339-6/servers => generated 275 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:47.138135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Calling method '.version_select at 0x7eff5cf69550>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.139879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.140357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.140827 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.152598 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c7524a29-7a0b-4fe7-9eed-70e4d4dfcb5b tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.113127 Nov 02 12:35:47.160581 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 139/266] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 12:35:47 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:47.160581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.160581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.166681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.167195 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.167632 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.168354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.169024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.169646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.171496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.172014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.172509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.220739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.226589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.227114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.246103 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e400ce6d-1efe-4b8e-886e-9065ff19dd59 tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.111891 Nov 02 12:35:47.246655 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 128/267] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:47.258135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:47.291497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.292294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.292818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.300506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.301677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.302676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.312835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.compute.aggregates [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 12:35:47.313660 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Request method failure captured: Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 42 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPoQjYj-XjD-PDt70HBKWpgAte2xN7YYmeOFHUkqIkrv6qSPIg2shIHC1N_DkTT-WhwWQx9q78sRXdBmji8P_cEYg1mWAzahXZh8c1Ouifrfy_VyQchxzKDH5Wbbf00YAC-PDM5vSB3DXy3YKWIlbUVHLdhAIHI3DZRF1rHTHcEUSE Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:47.315729 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_153dd8a07bdd4e33a3f9b25bb6a4216f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/153dd8a07bdd4e33a3f9b25bb6a4216f"}]}] Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 153dd8a07bdd4e33a3f9b25bb6a4216f Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-369372218 Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebabe3e4fbdc48948f3d1b929cf175e4 Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: {"remove_host": {"host": "nonexist_host"}} Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:47.317089 n-d-857339-6 devstack@n-api.service[127766]: exception: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Nov 02 12:35:47.317765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Nov 02 12:35:47.319041 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.320159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Nov 02 12:35:47.321404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:47.323082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:47.324191 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d424acf3-7e52-4f30-9ff5-7beb75aff0d4 tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.074460 Nov 02 12:35:47.329078 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 129/268] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 12:35:47 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:35:47.342041 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Calling method '.version_select at 0x7eff5cee39d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.345014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.345896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.346544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.355862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.362105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.362801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.363383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.365399 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-22246d1a-1be8-46bb-ab7e-750c3d35b39c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.210265 Nov 02 12:35:47.373488 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d1175e4b-2fba-42da-8169-903f40db87eb tempest-HypervisorAdminUnderV252Test-968972224 tempest-HypervisorAdminUnderV252Test-968972224-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/n-h2-857339-6/search" status: 200 len: 104 microversion: 2.1 time: 0.039950 Nov 02 12:35:47.373488 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 130/269] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/os-hypervisors/n-h2-857339-6/search => generated 104 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:47.373708 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 140/270] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.377928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5a774f50-662f-4b2c-8645-8113dfe3b7de tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.474731 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5a774f50-662f-4b2c-8645-8113dfe3b7de tempest-AggregatesAdminNegativeTestJSON-369372218 tempest-AggregatesAdminNegativeTestJSON-369372218-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.102395 Nov 02 12:35:47.475826 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 131/271] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:35:47 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:35:47.628055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.628744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.635222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.635720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.636195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.636988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.637522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.638507 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.838308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.847440 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7ec08a96-2f67-4340-99c9-49a5047e3827 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.223482 Nov 02 12:35:47.848162 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 132/272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.852956 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdedb786-7c48-47e9-aa18-220972e9405e", "name": "network-vif-plugged", "status": "completed", "tag": "a911b949-15e2-47ba-aea9-5c8e8118311c"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:47.863861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.864643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.865099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.877375 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] Creating event network-vif-plugged:a911b949-15e2-47ba-aea9-5c8e8118311c for instance fdedb786-7c48-47e9-aa18-220972e9405e on n-h2-857339-6 Nov 02 12:35:47.882626 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-c779fd1f-8a6d-4687-8686-6314376f3aa6 req-359e695b-f8a6-45b1-ab13-984a75fe9f72 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033108 Nov 02 12:35:47.883792 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 133/273] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:48.078908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.079795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.086849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.087898 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.088604 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.089615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.090299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.090971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.305235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.314917 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-295ab233-4210-478b-97e6-e998d25120dd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.240623 Nov 02 12:35:48.315734 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 134/274] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:48.398615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.406231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.411054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.412006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.412469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.415273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.415811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.416255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.432279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f70c43ae-1555-4d43-a0f8-87745853e8c5 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1641528282", "id": 2006182193, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:48.449838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:48.604367 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f70c43ae-1555-4d43-a0f8-87745853e8c5 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 1.076380 Nov 02 12:35:48.607781 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 141/275] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:47 2022] POST /compute/v2.1/flavors => generated 430 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:48.614167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:48.618600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e7b33bc1-0b8c-443c-b222-0cb6ccb83367 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.625855 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57685a16-c37d-4e17-9390-1afec2c14913 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1314 microversion: 2.1 time: 0.231715 Nov 02 12:35:48.654778 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 135/276] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:48.755392 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e7b33bc1-0b8c-443c-b222-0cb6ccb83367 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/2006182193" status: 202 len: 0 microversion: 2.1 time: 0.140574 Nov 02 12:35:48.756681 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 142/277] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:48 2022] DELETE /compute/v2.1/flavors/2006182193 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:48.766021 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80848ad5-34d9-4173-a0a5-f78e4a1f04d6 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.829354 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-80848ad5-34d9-4173-a0a5-f78e4a1f04d6 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068415 Nov 02 12:35:48.844150 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 136/278] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:48.853673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-53b66345-2dc0-4848-b9b7-4db247075aab tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-999901667", "id": 1295040736, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:48.871617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:48.872421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:48.878952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.879443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.880606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.881323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:48.883171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:48.883171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.001335 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-53b66345-2dc0-4848-b9b7-4db247075aab tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.150736 Nov 02 12:35:49.005108 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 143/279] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:48 2022] POST /compute/v2.1/flavors => generated 416 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:49.018167 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d10ce391-71a5-4c98-a012-12c10fd6bb1b tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.080580 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d10ce391-71a5-4c98-a012-12c10fd6bb1b tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.068849 Nov 02 12:35:49.084740 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 144/280] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:49.094484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.106971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d3ad49a-4e74-4888-b260-70c84b9a4332 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.109184 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-76c43969-699e-4d3a-8ee2-f9885efe34b2 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.239045 Nov 02 12:35:49.109906 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 137/281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:48 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:49.292298 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d3ad49a-4e74-4888-b260-70c84b9a4332 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1295040736" status: 202 len: 0 microversion: 2.1 time: 0.189718 Nov 02 12:35:49.295335 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 145/282] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:49 2022] DELETE /compute/v2.1/flavors/1295040736 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:35:49.305434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-be6e5386-a362-45d0-be55-c939affa95d8 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.341683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.342730 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:49.347832 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-be6e5386-a362-45d0-be55-c939affa95d8 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049095 Nov 02 12:35:49.351704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.365266 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 138/283] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:49.366255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.369095 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.380150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e46e78b2-6157-4c5e-8a05-abd60ddcd74a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-176971937", "id": 1149903772, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:49.381703 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.382372 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.382970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.407799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:49.514351 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e46e78b2-6157-4c5e-8a05-abd60ddcd74a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.142339 Nov 02 12:35:49.516950 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 139/284] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:49 2022] POST /compute/v2.1/flavors => generated 428 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:49.531654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ee8a7a79-7af1-4993-b852-ced4900eb041 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.658127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.668664 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a4d70f9b-2b31-4c41-9082-47c5e7669813 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.333585 Nov 02 12:35:49.670215 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 146/285] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:49.675404 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.676587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=24 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:49.686411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:49.694980 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ee8a7a79-7af1-4993-b852-ced4900eb041 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1149903772" status: 202 len: 0 microversion: 2.1 time: 0.163417 Nov 02 12:35:49.702406 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 140/286] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:49 2022] DELETE /compute/v2.1/flavors/1149903772 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:35:49.706889 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.707597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.709247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.709358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-20f54ffc-f3ed-48ab-a8ac-00069ea8ea95 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.709452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.709887 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.710502 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.759768 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-20f54ffc-f3ed-48ab-a8ac-00069ea8ea95 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056009 Nov 02 12:35:49.775758 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 141/287] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:49.784996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5449d639-6734-46ff-ab7d-e8f6ed064078 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1028357223", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:49.861291 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5449d639-6734-46ff-ab7d-e8f6ed064078 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.079901 Nov 02 12:35:49.868879 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 142/288] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:49 2022] POST /compute/v2.1/flavors => generated 507 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:49.876442 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dcfe5201-f34d-445c-9c77-334c3ff7c907 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:49.946369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:49.958411 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1df1bec0-73bd-4e58-8106-f7b68d6a9dde tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1464 microversion: 2.1 time: 0.286950 Nov 02 12:35:49.968769 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 147/289] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:49 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1464 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:49.980163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770566dc-692d-4e7a-ad96-d33a9c01be92", "name": "network-vif-plugged", "status": "completed", "tag": "0b5c2458-e96d-4ef7-91f3-71586f8654af"}, {"server_uuid": "b675eccd-9fed-4d65-b56b-80a0f46b523f", "name": "network-vif-plugged", "status": "completed", "tag": "df5c0c04-c31c-4b89-89ec-fb14f2763e26"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:49.991118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.991831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.992330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.006728 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dcfe5201-f34d-445c-9c77-334c3ff7c907 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/3a3aca49-9049-4c26-9959-77a86f22425c" status: 202 len: 0 microversion: 2.1 time: 0.136182 Nov 02 12:35:50.006949 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Creating event network-vif-plugged:0b5c2458-e96d-4ef7-91f3-71586f8654af for instance 770566dc-692d-4e7a-ad96-d33a9c01be92 on n-h2-857339-6 Nov 02 12:35:50.007837 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 143/290] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:49 2022] DELETE /compute/v2.1/flavors/3a3aca49-9049-4c26-9959-77a86f22425c => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:50.007978 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] Creating event network-vif-plugged:df5c0c04-c31c-4b89-89ec-fb14f2763e26 for instance b675eccd-9fed-4d65-b56b-80a0f46b523f on n-h1-857339-6 Nov 02 12:35:50.016741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.017362 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:50.019414 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-2917cf53-13d0-4041-b8eb-fb349ddf7157 req-bd078f8a-2cb4-49d8-9af5-ed69cc021d94 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049314 Nov 02 12:35:50.020026 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 148/291] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:50.024667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.025327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.025909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.027091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.027552 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.028562 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.049610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-024243a6-28a8-4a27-9ad4-29838b9c7953 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.103261 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-024243a6-28a8-4a27-9ad4-29838b9c7953 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075607 Nov 02 12:35:50.107283 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 149/292] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:50.126784 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1b2c2afb-9666-4bd3-a815-fa4943fc8274 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1324678325", "id": "c1216441-74bc-440a-a9da-45610551a454", "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:50.212440 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1b2c2afb-9666-4bd3-a815-fa4943fc8274 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.090369 Nov 02 12:35:50.213718 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 150/293] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:50 2022] POST /compute/v2.1/flavors => generated 507 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:50.219469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.220211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:50.228770 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.229260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.229873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.230761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.231402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.232084 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.524960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:50.533022 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-205f880c-6428-451f-9c94-1847fc60b64c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1313 microversion: 2.1 time: 0.523711 Nov 02 12:35:50.534286 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 144/294] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1313 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:50.539170 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8c726863-1930-41d6-bdb3-ffefa4736420 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.580621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:50.588664 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1ba1fb28-d38b-43b0-806b-fb878f03def0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.373672 Nov 02 12:35:50.589753 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 151/295] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:50.699180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:50.699945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:50.706865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.707354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.707789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.708548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:50.709014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:50.709443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:50.864597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:50.886507 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2c1bce7d-618e-4704-80d0-1c202cdf348f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.191343 Nov 02 12:35:50.887130 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 152/296] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:50.922414 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8c726863-1930-41d6-bdb3-ffefa4736420 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/c1216441-74bc-440a-a9da-45610551a454" status: 202 len: 0 microversion: 2.1 time: 0.386544 Nov 02 12:35:50.925503 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 145/297] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:50 2022] DELETE /compute/v2.1/flavors/c1216441-74bc-440a-a9da-45610551a454 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:50.934111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7f714b3c-78bd-450e-bafe-48a2228773c7 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.008735 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7f714b3c-78bd-450e-bafe-48a2228773c7 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076562 Nov 02 12:35:51.011056 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 153/298] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:51.045403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ca86dcd1-176b-437e-ba99-6be1c751535a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1773457663", "id": 1358620879, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:51.149656 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ca86dcd1-176b-437e-ba99-6be1c751535a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.124589 Nov 02 12:35:51.157845 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 146/299] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:51 2022] POST /compute/v2.1/flavors => generated 414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:51.162367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c44b418a-1a8b-4f8b-9b07-320e5d32ba69 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.164626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:51.172032 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c44b418a-1a8b-4f8b-9b07-320e5d32ba69 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/1358620879" status: 200 len: 414 microversion: 2.1 time: 0.013277 Nov 02 12:35:51.173621 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 154/300] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/flavors/1358620879 => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:51.558015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a07da1ee-f3f6-4287-b6fc-c644bd69ce1a tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.560290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.560290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:51.574841 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.575631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.576256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.577025 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.577460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.577885 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.608092 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a07da1ee-f3f6-4287-b6fc-c644bd69ce1a tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.424867 Nov 02 12:35:51.609372 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 147/301] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:51.620791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.620791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:51.637277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.638114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.638731 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.640387 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.641019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.641610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.933069 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:51.937226 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:51.945645 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1ee59e59-5821-4354-bd10-e258ae0f3249 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1313 microversion: 2.1 time: 0.394402 Nov 02 12:35:51.946620 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1e38ee0d-cd4a-4c27-ac77-77466da6fb28 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1319 microversion: 2.1 time: 0.335951 Nov 02 12:35:51.946876 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 155/302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:51.947852 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 148/303] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:51.952135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-81bfb4f8-6d88-4219-b4ad-1d1aa0965f2a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.954792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:51.955767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:51.964888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.969983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.969983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:51.969983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:51.969983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:51.970361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.127912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:52.137663 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e090c367-710b-4c7c-93fc-d9171729f622 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1312 microversion: 2.1 time: 0.188276 Nov 02 12:35:52.155303 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 149/304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:51 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:52.155303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-plugged", "status": "completed", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:52.161605 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-81bfb4f8-6d88-4219-b4ad-1d1aa0965f2a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1358620879" status: 202 len: 0 microversion: 2.1 time: 0.213439 Nov 02 12:35:52.174475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.174475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.174475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.175417 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 156/305] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:51 2022] DELETE /compute/v2.1/flavors/1358620879 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:52.181359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-13080e56-10f8-482d-95d0-37c18f159b2d tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.182311 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] Creating event network-vif-plugged:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:35:52.189202 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-7b53cf11-4edd-47d0-a25c-03b772689f12 req-4842a584-091d-4533-ba87-596107a7b80a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049289 Nov 02 12:35:52.190232 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 150/306] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:52.206108 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-13080e56-10f8-482d-95d0-37c18f159b2d tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028018 Nov 02 12:35:52.213136 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 157/307] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:52.227488 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4c756df9-795f-4ab1-979e-8d51ba9178df tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1524471884", "id": 896977344, "os-flavor-access:is_public": "False"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:52.487287 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4c756df9-795f-4ab1-979e-8d51ba9178df tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.260106 Nov 02 12:35:52.499186 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 151/308] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:52 2022] POST /compute/v2.1/flavors => generated 427 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:52.528715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7d6e4573-4900-4aa2-ae5e-d01af3180cec tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "896977344"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:52.559838 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7d6e4573-4900-4aa2-ae5e-d01af3180cec tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] HTTP exception thrown: Flavor 896977344 could not be found. Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7d6e4573-4900-4aa2-ae5e-d01af3180cec tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Request method failure captured: Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 106 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQivDq55QeBh12XM-e8X8z7f7wo58k4Vqnh5pLfHqM9x5RvOSE6KvOYKAls7e44zNsYOkZX63EHGUIwLmPUqhvxSN4DqFNd7RutDyUrIxL7iZ6hMW5HQmqOJExSLRUfJZXhJ2mPlmNOkrptiaiUIA80VDTvBusEtLBqQ9PB_MfvNcE Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0f2c7334e03a44f8a101032e7caaff05 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsAdminTestJSON-112214649 Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:35:52.567635 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0f2c7334e03a44f8a101032e7caaff05", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f2c7334e03a44f8a101032e7caaff05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0f2c7334e03a44f8a101032e7caaff05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0f2c7334e03a44f8a101032e7caaff05"}]}] Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsAdminTestJSON-112214649 Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0f2c7334e03a44f8a101032e7caaff05 Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-112214649 Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsAdminTestJSON-112214649-project Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a6bb0af667424d04a5c51e1ad704cdb5 Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsAdminTestJSON-112214649-project Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "test", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "896977344"}} Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:35:52.576104 n-d-857339-6 devstack@n-api.service[127767]: exception: Flavor 896977344 could not be found. Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '896977344'}}} Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 896977344 could not be found. Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:52.577221 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 896977344 could not be found. Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:52.578775 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 896977344 could not be found. Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7d6e4573-4900-4aa2-ae5e-d01af3180cec tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Returning 400 to user: Flavor 896977344 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7d6e4573-4900-4aa2-ae5e-d01af3180cec tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.063532 Nov 02 12:35:52.581126 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 158/309] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:52 2022] POST /compute/v2.1/servers => generated 80 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:35:52.588377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e2b029c0-a06c-490d-b6c2-d85684e1850f tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.618699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=17,nova_api:INSERT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:52.698220 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e2b029c0-a06c-490d-b6c2-d85684e1850f tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/896977344" status: 202 len: 0 microversion: 2.1 time: 0.114786 Nov 02 12:35:52.703652 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 152/310] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:35:52 2022] DELETE /compute/v2.1/flavors/896977344 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:52.711670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f0785e2f-3889-4633-8509-38ae2d5dad6c tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.755119 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f0785e2f-3889-4633-8509-38ae2d5dad6c tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050622 Nov 02 12:35:52.760341 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 159/311] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:52.782867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d29c076a-8cfe-4b0a-b629-a783412c95be tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-295920119", "id": 1084662653, "os-flavor-access:is_public": "False"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:52.883919 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d29c076a-8cfe-4b0a-b629-a783412c95be tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.104793 Nov 02 12:35:52.885139 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 153/312] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:52 2022] POST /compute/v2.1/flavors => generated 414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:52.898714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b023832c-95ee-464c-a125-80329bc2cca8 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-449215157", "id": 1759569519, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:52.968479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:52.969230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:52.976264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.976808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.977261 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:52.978610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:52.979260 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:52.979859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.021365 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b023832c-95ee-464c-a125-80329bc2cca8 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.127223 Nov 02 12:35:53.022275 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 160/313] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:52 2022] POST /compute/v2.1/flavors => generated 413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:53.033138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.033969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:53.047830 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.052597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.053451 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.054595 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.055286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.055898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.351440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:53.370281 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-807c4e48-e897-4a88-a78d-23ba91e6f1b6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1313 microversion: 2.1 time: 0.402415 Nov 02 12:35:53.385240 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 154/314] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:52 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1313 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:53.399833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fcbef36b-6416-4d72-827c-f2f5837004f0 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.433658 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fcbef36b-6416-4d72-827c-f2f5837004f0 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.047053 Nov 02 12:35:53.446556 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 155/315] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:53.461828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.462457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:53.476177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.476973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.477595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.478475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.479095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.479680 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.483585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:53.520387 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-88a7346a-45d2-46c3-a47c-6df4461ae9d0 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1469 microversion: 2.1 time: 0.496135 Nov 02 12:35:53.539486 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:53.539905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-57bfe2f4-c7f1-4e72-987f-0a9e2bd8a202 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.595843 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-57bfe2f4-c7f1-4e72-987f-0a9e2bd8a202 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.071500 Nov 02 12:35:53.605045 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 162/317] 10.222.0.64 () {58 vars in 1177 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:53.609022 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:53.626098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:53.633468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.654352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.654352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.654352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:53.654352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:53.654898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:53.774502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:53.787439 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-37cebddf-6327-49ea-92d5-3a1d53c269cb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1461 microversion: 2.1 time: 0.339429 Nov 02 12:35:53.788343 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 156/318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1461 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:53.795200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ce0f030-0007-422f-bb30-1aa132fae311 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:53.807260 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9ce0f030-0007-422f-bb30-1aa132fae311 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017370 Nov 02 12:35:53.807871 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 157/319] 10.222.0.64 () {58 vars in 1171 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:54.120665 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aa7d47e1-ee11-485a-acab-faecdcfad8ac tempest-DeleteServersAdminTestJSON-765563440 tempest-DeleteServersAdminTestJSON-765563440-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92/action" status: 202 len: 0 microversion: 2.1 time: 0.516954 Nov 02 12:35:54.121951 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 163/320] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:53 2022] POST /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:54.130040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aa376b7f-ba4f-4721-933f-ff1816aed8e6 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.138325 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aa376b7f-ba4f-4721-933f-ff1816aed8e6 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.014193 Nov 02 12:35:54.138918 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 164/321] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:54.165805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.168325 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.175935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.176505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.177201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.178142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.178812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.179466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.217001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.217688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.218274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.218880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 770566dc-692d-4e7a-ad96-d33a9c01be92 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:54.406318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.406318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.421341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.422111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.422747 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.423735 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.424739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.425185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:54.439451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.446248 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-135b2a4e-2df7-4b71-b1fc-d14c400e83f7 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1452 microversion: 2.1 time: 0.277776 Nov 02 12:35:54.446248 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 165/322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1452 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:54.464072 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cd80b42f-d0b7-4bbf-adb1-fb5b7ae04578 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.492935 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cd80b42f-d0b7-4bbf-adb1-fb5b7ae04578 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.049164 Nov 02 12:35:54.500640 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 166/323] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:54.500640 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.509903 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.523162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.529926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.537414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.538193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.538678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.539179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.904853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:54.917626 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3d0a709f-fe4a-46cd-aeef-eb139a081832 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1462 microversion: 2.1 time: 0.422565 Nov 02 12:35:54.923363 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 167/324] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1462 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:54.928921 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.929721 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.944093 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.944967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.946669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.948208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.952874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.953351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.997336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:55.666681 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7478b7a3-2d55-4fe1-a9d8-93c9dd8f14c8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1612 microversion: 2.1 time: 1.856529 Nov 02 12:35:55.689009 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 158/325] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:53 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1612 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:55.692099 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de3d7645-4ba5-468b-8478-7d49fa791feb tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 204 len: 0 microversion: 2.1 time: 0.766918 Nov 02 12:35:55.694494 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 168/326] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:54 2022] DELETE /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:55.699115 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-39367608-4734-4260-9155-3e85cc99cf78 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:55.704696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-122825744", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "63d0ddc9-7d7b-463a-9055-b118b37d85c1"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:55.728821 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-39367608-4734-4260-9155-3e85cc99cf78 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.038354 Nov 02 12:35:55.736965 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 159/327] 10.222.0.64 () {58 vars in 1175 bytes} [Wed Nov 2 12:35:55 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:55.736965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:55.736965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:55.743987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:55.745036 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:55.745669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:55.747173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:55.747851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:55.748788 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:55.882231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b) Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:56.069432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.072961 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:56.074173 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b) Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:56.075139 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Request method failure captured: Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f/action HTTP/1.1 Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 15 Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQLx3IDTZGxhKhLI9_nRs10rIjiqd_Qi3cmGMashjMAvq5IPa3RJVmTSj0OUGJWp7NuUar8RJkxsfLoRqdMrY3fQHb0Xk4FqxPoUjRQ8yNKtt_kjJ9aUpkTrdeqjfjQ_VQ_aPgzd-7B2JlyVQoP8_pU8jYFEuwSKnCg4gHiCeUe6Uc Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:35:56.075899 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2046c3ec9ae24830ac6194791d986f0d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}] Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-MigrationsAdminTest-293810145 Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 1f30f86e527d484fa6f592b13e4c081d Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: {"migrate": {}} Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:35:56.077407 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'b675eccd-9fed-4d65-b56b-80a0f46b523f', 'body': {'migrate': {}}} Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:35:56.078151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:35:56.079163 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:35:56.081948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-646a4b29-a9d6-4e4c-b7ff-cbbd6e0df96b) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:35:56.085503 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:35:56.086922 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:56.087864 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0d18cd81-90cd-4ea4-8704-984594da3bde tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f/action" status: 500 len: 214 microversion: 2.1 time: 0.342611 Nov 02 12:35:56.087864 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 160/328] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:35:55 2022] POST /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f/action => generated 214 bytes in 344 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:35:56.087864 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.087864 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:56.093551 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.094053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.094572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.095620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.096082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.096527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.154057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.154553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.154990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.156124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 770566dc-692d-4e7a-ad96-d33a9c01be92 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:56.237927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:56.238467 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:56.238944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:56.239297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:56.239715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:56.267447 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.269183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.269799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.271460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.272120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.273027 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.296535 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:56.301674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Getting quotas for user a0475d03f0e14972a733ba9db2d32947 and project 6e09079e89384417879f678c0a4df5c2. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:56.316986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:56.319752 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:56.339598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:56.348847 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ee03429a-0e94-4242-9255-aab86268b3d8 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1458 microversion: 2.1 time: 0.273152 Nov 02 12:35:56.350903 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 161/329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1458 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:56.371004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-264f73d3-291d-4804-8171-56959ceab213 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.407790 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-264f73d3-291d-4804-8171-56959ceab213 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.045585 Nov 02 12:35:56.409246 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 162/330] 10.222.0.64 () {58 vars in 1173 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:56.536369 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-78efe8f3-c004-46ed-aaae-1478da7e3283 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.839424 Nov 02 12:35:56.537541 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 169/331] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:56.565377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-755a5e36-7eee-447e-ad1b-497b92e7f0d1 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '.version_select at 0x7eff5ccfe160>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.584923 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-755a5e36-7eee-447e-ad1b-497b92e7f0d1 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:56.585420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-755a5e36-7eee-447e-ad1b-497b92e7f0d1 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:56.585863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-755a5e36-7eee-447e-ad1b-497b92e7f0d1 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.652047 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-755a5e36-7eee-447e-ad1b-497b92e7f0d1 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/os-migrations" status: 200 len: 18 microversion: 2.1 time: 0.104024 Nov 02 12:35:56.653246 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 170/332] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/os-migrations => generated 18 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:35:56.704797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7f159919-c483-4ab0-a6b0-196a2abcf354 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.764285 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7f159919-c483-4ab0-a6b0-196a2abcf354 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.085873 Nov 02 12:35:56.779390 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 171/333] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:56.801607 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-092e9e7f-90d6-43c7-bc7e-2f2a4035e383 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:56.801607 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-092e9e7f-90d6-43c7-bc7e-2f2a4035e383 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:56.918700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-092e9e7f-90d6-43c7-bc7e-2f2a4035e383 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:56.927879 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-092e9e7f-90d6-43c7-bc7e-2f2a4035e383 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1213 microversion: 2.1 time: 0.146785 Nov 02 12:35:56.933701 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 172/334] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:56.934994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-58f8cccf-7669-4ea8-a325-74108b28ce3f tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.052334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9f462c1b-2bf6-4f18-bbc2-530e81350745 tempest-InstanceUsageAuditLogTestJSON-1315096743 tempest-InstanceUsageAuditLogTestJSON-1315096743-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.101662 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9f462c1b-2bf6-4f18-bbc2-530e81350745 tempest-InstanceUsageAuditLogTestJSON-1315096743 tempest-InstanceUsageAuditLogTestJSON-1315096743-project-admin] 10.222.0.64 "GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02 12:35:56" status: 200 len: 318 microversion: 2.1 time: 0.691066 Nov 02 12:35:57.103641 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 163/335] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:35:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-11-02%2012%3A35%3A56 => generated 318 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:57.116375 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-58f8cccf-7669-4ea8-a325-74108b28ce3f tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1759569519" status: 202 len: 0 microversion: 2.1 time: 0.185492 Nov 02 12:35:57.117295 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 173/336] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:56 2022] DELETE /compute/v2.1/flavors/1759569519 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:57.126741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-17b464f1-eea7-42f4-9d39-3acf3485a702 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.130613 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54103d55-8ff2-4847-af76-b4190af2cef3 tempest-InstanceUsageAuditLogTestJSON-1315096743 tempest-InstanceUsageAuditLogTestJSON-1315096743-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.171755 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-17b464f1-eea7-42f4-9d39-3acf3485a702 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050121 Nov 02 12:35:57.172208 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-54103d55-8ff2-4847-af76-b4190af2cef3 tempest-InstanceUsageAuditLogTestJSON-1315096743 tempest-InstanceUsageAuditLogTestJSON-1315096743-project-admin] 10.222.0.64 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.052847 Nov 02 12:35:57.173222 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 164/337] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:57.187087 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 174/338] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:57.206086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1431249429", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:57.217216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c1b7971f-d650-4f09-992e-c2a356ac0def tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.302253 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=9 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:57.310509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:57.366424 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c1b7971f-d650-4f09-992e-c2a356ac0def tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1084662653" status: 202 len: 0 microversion: 2.1 time: 0.173437 Nov 02 12:35:57.372292 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 175/339] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:35:57 2022] DELETE /compute/v2.1/flavors/1084662653 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:57.377665 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:57.378293 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:57.384645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.385193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.385874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.386617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.387160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.388103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.441197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:57.441690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:57.442134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:57.442597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 770566dc-692d-4e7a-ad96-d33a9c01be92 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:58.061503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:58.075428 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-484517b7-4f06-4706-9922-4f081b39ec1f tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1458 microversion: 2.1 time: 0.699041 Nov 02 12:35:58.077442 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 176/340] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:57 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1458 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:58.099271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bf796ff7-9213-4348-9b1f-3f9f4f083fd7 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.147473 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bf796ff7-9213-4348-9b1f-3f9f4f083fd7 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068136 Nov 02 12:35:58.148067 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 177/341] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:58.153209 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.154041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:58.164759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.165545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.167510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.168629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.169309 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.170108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.307035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:58.320378 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5a110fd7-c106-4f71-9205-dce5cf8b3e37 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1217 microversion: 2.1 time: 0.169621 Nov 02 12:35:58.320586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:58.320586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:58.321140 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 178/342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1217 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:58.323009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:58.323446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:58.324212 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:58.325372 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b703e411-60b4-4718-aace-05df43135932 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1778097057", "id": 352566364, "os-flavor-access:is_public": "False"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:58.335763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.336289 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.336763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.342025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:58.342025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:58.342025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:58.369590 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:58.377455 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for user 976993a09f2342c68dab07da6a7dd236 and project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:58.405423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:58.410342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:58.494312 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b703e411-60b4-4718-aace-05df43135932 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.173017 Nov 02 12:35:58.495421 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 179/343] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:58 2022] POST /compute/v2.1/flavors => generated 412 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:58.514366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b6625910-920c-4335-a863-db999378840a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.559829 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b6625910-920c-4335-a863-db999378840a tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049838 Nov 02 12:35:58.559829 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 180/344] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:58.593566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-497be8a4-686c-4fc9-8e42-12f1226655ce tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.613225 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-de52da89-75b7-48b3-b0cc-5b9326c0dbd8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.417144 Nov 02 12:35:58.615712 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 165/345] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:58.635427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bfe0b5b2-890b-42da-a17f-f67cd5d6d207 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.637721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bfe0b5b2-890b-42da-a17f-f67cd5d6d207 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:58.670534 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-497be8a4-686c-4fc9-8e42-12f1226655ce tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097030 Nov 02 12:35:58.672934 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 181/346] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:58.705116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-df2cb3ed-c362-457d-a227-7eb9eef50490 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.719118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:58.839670 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-df2cb3ed-c362-457d-a227-7eb9eef50490 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/352566364" status: 202 len: 0 microversion: 2.1 time: 0.150119 Nov 02 12:35:58.843323 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 182/347] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:35:58 2022] DELETE /compute/v2.1/flavors/352566364 => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:35:58.849200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dc655ce1-7424-461d-ab53-5e56d41e1fa2 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:58.911862 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dc655ce1-7424-461d-ab53-5e56d41e1fa2 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066518 Nov 02 12:35:58.927305 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 183/348] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:58.941142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0213c8d1-7597-4d03-b4ce-adb9ec15c6eb tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-462219886", "id": 462183932, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:58.999109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bfe0b5b2-890b-42da-a17f-f67cd5d6d207 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.011351 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bfe0b5b2-890b-42da-a17f-f67cd5d6d207 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1213 microversion: 2.1 time: 0.380008 Nov 02 12:35:59.014213 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 166/349] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:58 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1213 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:59.071840 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0213c8d1-7597-4d03-b4ce-adb9ec15c6eb tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.134570 Nov 02 12:35:59.073538 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 184/350] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:58 2022] POST /compute/v2.1/flavors => generated 410 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:59.093024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d65f3262-b6db-4bec-b774-6b99b02599af tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.130337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.130337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:59.202718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.206773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.207711 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.214496 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.215475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.216532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.275540 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d65f3262-b6db-4bec-b774-6b99b02599af tempest-FlavorsAdminTestJSON-112214649 tempest-FlavorsAdminTestJSON-112214649-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.191494 Nov 02 12:35:59.282854 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 167/351] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:59.287769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:59.300879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "770566dc-692d-4e7a-ad96-d33a9c01be92", "name": "network-vif-deleted", "tag": "0b5c2458-e96d-4ef7-91f3-71586f8654af"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:59.316020 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.321171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.329614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.344845 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] Creating event network-vif-deleted:0b5c2458-e96d-4ef7-91f3-71586f8654af for instance 770566dc-692d-4e7a-ad96-d33a9c01be92 on n-h2-857339-6 Nov 02 12:35:59.351152 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-fa6d6cb9-86ff-4178-9efa-a7f49e177297 req-4c48891c-ef50-47b1-bb2e-4447171da5b8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066584 Nov 02 12:35:59.359070 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 168/352] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:59.363313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-19faeed0-94bb-48ec-9500-ad69ed806cba tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.409211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.409211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.409211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.410827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 770566dc-692d-4e7a-ad96-d33a9c01be92 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:59.509121 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-19faeed0-94bb-48ec-9500-ad69ed806cba tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/462183932" status: 202 len: 0 microversion: 2.1 time: 0.155167 Nov 02 12:35:59.509956 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 169/353] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:35:59 2022] DELETE /compute/v2.1/flavors/462183932 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:35:59.515426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.516243 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:59.541084 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.545722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.555384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.556437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:59.557102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:59.560028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:59.600441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.611884 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e92390b1-d44d-4d10-b35c-89c9e742342a tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1416 microversion: 2.1 time: 0.510961 Nov 02 12:35:59.625822 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 185/354] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1416 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:59.664926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7f7cbfc0-0531-45e3-a790-fa54eb416239 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:59.711065 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7f7cbfc0-0531-45e3-a790-fa54eb416239 tempest-FlavorsAdminTestJSON-1323614756 tempest-FlavorsAdminTestJSON-1323614756-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050132 Nov 02 12:35:59.712773 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 186/355] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:59.714202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:59.724898 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5cf1911d-b407-442a-ad17-25f93ee403f9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1265 microversion: 2.1 time: 0.213774 Nov 02 12:35:59.756171 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 170/356] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:59 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:00.040634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d888072a-9395-4007-8915-5ed0014f9c20 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:00.041831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d888072a-9395-4007-8915-5ed0014f9c20 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:00.152089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d888072a-9395-4007-8915-5ed0014f9c20 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:00.175623 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d888072a-9395-4007-8915-5ed0014f9c20 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1213 microversion: 2.1 time: 0.141911 Nov 02 12:36:00.176217 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 187/357] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:00 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:00.645422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:00.651291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:00.665279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.665957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.687874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.689158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.689887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.700021 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.760103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.761497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.763079 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.763688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lazy-loading 'fault' on Instance uuid 770566dc-692d-4e7a-ad96-d33a9c01be92 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:00.764854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:00.765631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:00.793701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.795774 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.797773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.800160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:00.803547 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:00.804205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:00.982853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936480fc35244d79a3ec7157060a1dbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ea3b8ac6b104721ba07c7b85bbb64aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:00.994517 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2621e4be-9adf-44bb-bb37-201cb6028966 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 200 len: 1309 microversion: 2.1 time: 0.358860 Nov 02 12:36:01.013919 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 171/358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:00 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:01.068345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.095728 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c0471db4-07d5-4389-aac4-a9d75b5421c9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1283 microversion: 2.1 time: 0.336028 Nov 02 12:36:01.096408 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 188/359] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:00 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1283 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:01.199327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:01.200883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:01.217188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.217684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.218121 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.218833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:01.219325 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:01.219752 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:01.350046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:01.360712 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c5c59452-c088-41e4-8474-7c95e7f8fce2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1217 microversion: 2.1 time: 0.165404 Nov 02 12:36:01.366201 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 172/360] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:01 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:02.032750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.033489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.053594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.055308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.063165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.063165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.063165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.063165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 HTTP/1.1 Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:02.089591 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.091891 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '770566dc-692d-4e7a-ad96-d33a9c01be92'} Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:02.093240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.094871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.096003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:02.111269 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-967b89d1-e7f4-4e94-b75c-9ce94357387e tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 404 len: 111 microversion: 2.1 time: 0.084444 Nov 02 12:36:02.112243 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 189/361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:02.123497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.124088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.140703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.142308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.142772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.143524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.149629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.149923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.178284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.179081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.223186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.227378 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.231132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.238588 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.239606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.242481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.259386 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 HTTP/1.1 Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:02.270043 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.274484 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '770566dc-692d-4e7a-ad96-d33a9c01be92'} Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:02.275144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.276239 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.282309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:02.285984 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b9544a8-a107-4a3a-8686-d0c78c5d5614 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 404 len: 111 microversion: 2.1 time: 0.166826 Nov 02 12:36:02.288893 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 173/362] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:02 2022] DELETE /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:36:02.306167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.310955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 770566dc-692d-4e7a-ad96-d33a9c01be92] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.328945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.331594 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.336191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.338162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.339389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.340632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.367237 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 HTTP/1.1 Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:02.369145 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.370666 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '770566dc-692d-4e7a-ad96-d33a9c01be92'} Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:02.371564 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. Nov 02 12:36:02.373872 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.377094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 770566dc-692d-4e7a-ad96-d33a9c01be92 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:02.377094 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-28059ee6-4fcf-40ef-b94a-6d516aa85d86 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92" status: 404 len: 111 microversion: 2.1 time: 0.079076 Nov 02 12:36:02.386189 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 174/363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/770566dc-692d-4e7a-ad96-d33a9c01be92 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:02.393817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.395193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.404606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.405412 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.405952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.406804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.407378 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.407913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.425654 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa HTTP/1.1 Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:02.427452 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.429935 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '897625a4-b4a8-4753-ae04-d1a24f14d3fa'} Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:02.431308 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.434101 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.435570 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:02.436519 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2f8b9d8a-1efa-473b-974d-31c5d4d234fc tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "DELETE /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 404 len: 111 microversion: 2.1 time: 0.045636 Nov 02 12:36:02.437096 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 175/364] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:02 2022] DELETE /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:02.442662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.443577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.467823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.479408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.480247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.481575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.484395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.485263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.677719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.694656 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:02.697401 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ff8453b4-8a71-411b-8d16-fba63a25d059 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.565639 Nov 02 12:36:02.712656 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 190/365] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:02.716845 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-986bd956-b95c-48f0-b12a-ca231b76e59f tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1265 microversion: 2.1 time: 0.278409 Nov 02 12:36:02.717772 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 176/366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:02.727690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:02.728312 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] [instance: 897625a4-b4a8-4753-ae04-d1a24f14d3fa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:02.748102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.748632 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.749074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.749790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:02.750251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:02.750670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:02.785369 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] HTTP exception thrown: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Request method failure captured: Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa HTTP/1.1 Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmPl8Bemlw067kc8vxA08iBx54ndMfkDMqBfeoi6lzaqj5dirO6XbIZzm2hqU84kOUfe49-11Y67ctGsBaeIBN5PUpc24TDeVPMHNLD0nvATrjAE4okbUfmLljDjaESic5DmGGcNtqE14TQdEDMUpB-i4GimN2whUJFscePMcQ_QZ8k Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:02.787010 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8ea3b8ac6b104721ba07c7b85bbb64aa", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8ea3b8ac6b104721ba07c7b85bbb64aa"}]}] Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8ea3b8ac6b104721ba07c7b85bbb64aa Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1684711551 Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 936480fc35244d79a3ec7157060a1dbc Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersAdminTestJSON-1684711551-project Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.804184 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '897625a4-b4a8-4753-ae04-d1a24f14d3fa'} Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:02.805135 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. Nov 02 12:36:02.806464 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:02.807641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] Returning 404 to user: Instance 897625a4-b4a8-4753-ae04-d1a24f14d3fa could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:02.807641 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-95e1eb77-222b-4eaf-b4be-a4d81cfe0e64 tempest-DeleteServersAdminTestJSON-1684711551 tempest-DeleteServersAdminTestJSON-1684711551-project] 10.222.0.64 "GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa" status: 404 len: 111 microversion: 2.1 time: 0.074533 Nov 02 12:36:02.807641 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 191/367] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:02 2022] GET /compute/v2.1/servers/897625a4-b4a8-4753-ae04-d1a24f14d3fa => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:03.726515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:03.727307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:03.745630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.746737 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.747188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.747363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:03.748081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:03.748213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.748367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.759252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.766412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.766913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.767356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.768094 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.768591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.769024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.949854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:03.970986 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1e87eeb9-5aba-45fd-ba70-ccdaff892751 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1271 microversion: 2.1 time: 0.229670 Nov 02 12:36:03.972001 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 192/368] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:03 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:04.091241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:04.095284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:04.101859 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb68b500-27c5-4147-9921-a15cdb20e65c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.379215 Nov 02 12:36:04.130784 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 177/369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:03 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:04.371017 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c232408a-2db9-4b25-b804-8792615c1d99", "tag": "fb604afe-95f1-4593-9fa2-2ef9bef29837"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:04.394264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:04.398211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:04.400289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:04.448716 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] Creating event network-changed:fb604afe-95f1-4593-9fa2-2ef9bef29837 for instance c232408a-2db9-4b25-b804-8792615c1d99 on n-h1-857339-6 Nov 02 12:36:04.470159 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-1aea1561-feee-4039-95e4-b034961de19a req-f46e0b6b-03ae-46b8-8bf0-34fbf0606507 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108331 Nov 02 12:36:04.471685 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 193/370] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:05.016544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:05.016544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:05.036238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.036812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.037276 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.038022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.038557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.039264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.139796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:05.156139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:05.167298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.170125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.173847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.175105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.175759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.176401 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.974458 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:05.986968 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b2d21ba8-1721-4fd5-95ea-b35f44f95161 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.977695 Nov 02 12:36:05.987589 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 178/371] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:05 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:06.050397 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:06.072943 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d1513be6-03e7-424b-8275-a7c2e37e5430 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.938399 Nov 02 12:36:06.078164 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 194/372] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:05 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:06.574658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b2c89a45-2a6b-45cc-8616-25361a1a53d3 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-984021832", "id": 1986752305, "os-flavor-access:is_public": "False"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:06.680523 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b2c89a45-2a6b-45cc-8616-25361a1a53d3 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.688035 Nov 02 12:36:06.681398 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 179/373] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:05 2022] POST /compute/v2.1/flavors => generated 430 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:06.699196 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-13e39149-6cd1-4117-ab4b-c5a2702cc2f3 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "04d8baa1af2f480b911d02ed2302c250"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:06.735453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:07.010824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:07.011490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:07.022874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.023406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.023853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.028143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.030242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.030715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.268841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:07.270822 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3fc619ef-2e7e-4ed6-a364-d221a7166a88 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.263945 Nov 02 12:36:07.271878 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 180/374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:07 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:07.277335 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:07.278205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:07.285255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.285967 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.286698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.287834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.288466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.289125 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.555147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:07.574365 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57ef923d-a6f3-45bf-ab97-978eee88de38 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.301151 Nov 02 12:36:07.581815 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 181/375] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:07 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:07.594156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c15163-d75c-45bd-8a07-f7d7b7d37455", "tag": "4fd2315f-3bee-4c55-9a39-5f59138d2385"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:07.609537 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:07.610136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:07.610569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:07.625953 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] Creating event network-changed:4fd2315f-3bee-4c55-9a39-5f59138d2385 for instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 on n-h1-857339-6 Nov 02 12:36:07.633984 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-ae11be17-6801-4b54-9e6d-b2eabd0af3ea req-cbf86723-84ea-46d2-8190-e128789cd71f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050003 Nov 02 12:36:07.640134 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 182/376] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:07.819449 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-13e39149-6cd1-4117-ab4b-c5a2702cc2f3 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1986752305/action" status: 200 len: 97 microversion: 2.1 time: 1.126815 Nov 02 12:36:07.821508 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 195/377] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:06 2022] POST /compute/v2.1/flavors/1986752305/action => generated 97 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:08.297322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:08.298523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:08.316556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c9191aad-2caa-408d-85b4-068a98570c9e tempest-FlavorsAccessTestJSON-1456660330 tempest-FlavorsAccessTestJSON-1456660330-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:08.374307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:08.374307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:08.374307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:08.374307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:08.375168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:08.375168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:08.375377 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c9191aad-2caa-408d-85b4-068a98570c9e tempest-FlavorsAccessTestJSON-1456660330 tempest-FlavorsAccessTestJSON-1456660330-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5411 microversion: 2.1 time: 0.513659 Nov 02 12:36:08.375377 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 183/378] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:07 2022] GET /compute/v2.1/flavors/detail => generated 5411 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:08.390913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c4706fd6-689a-41a4-b980-c2bbfb6d407b tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "04d8baa1af2f480b911d02ed2302c250"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:08.401742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:08.539087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:08.548344 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2eeeacac-7463-4cdc-a166-035b3960c47d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.258407 Nov 02 12:36:08.565245 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 196/379] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:08 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:08.622773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:08.622773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:08.625287 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:08.626427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:08.627210 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:08.629600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:08.630701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:08.631794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:08.855156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:08.870985 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-840e3180-bd2d-4cd4-ac3e-a1dc6beea132 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.267702 Nov 02 12:36:08.876622 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 197/380] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:08 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:09.004957 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c4706fd6-689a-41a4-b980-c2bbfb6d407b tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1986752305/action" status: 200 len: 21 microversion: 2.1 time: 0.620163 Nov 02 12:36:09.015183 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 184/381] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:08 2022] POST /compute/v2.1/flavors/1986752305/action => generated 21 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:09.025978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86967d74-e01f-408b-8a9a-f70541f0bec2 tempest-FlavorsAccessTestJSON-1456660330 tempest-FlavorsAccessTestJSON-1456660330-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.091801 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-86967d74-e01f-408b-8a9a-f70541f0bec2 tempest-FlavorsAccessTestJSON-1456660330 tempest-FlavorsAccessTestJSON-1456660330-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069817 Nov 02 12:36:09.108185 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 198/382] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:09.113085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aa0939e5-4f3c-4da0-847a-9b8ff4239852 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.131931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=16 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:09.140055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=7 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:09.222900 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aa0939e5-4f3c-4da0-847a-9b8ff4239852 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1986752305" status: 202 len: 0 microversion: 2.1 time: 0.113600 Nov 02 12:36:09.223510 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 185/383] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:09 2022] DELETE /compute/v2.1/flavors/1986752305 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:09.245757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d6340c91-b912-4761-a9e1-905f9e05b048 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.249745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15715fa7-7035-492c-bc05-e5125561e6b9 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd1e430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.313202 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d6340c91-b912-4761-a9e1-905f9e05b048 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079635 Nov 02 12:36:09.325126 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 199/384] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:09.344159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-910d9abc-5c12-46b7-b94c-427233f322c6 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-909937421", "id": 341910778, "os-flavor-access:is_public": "False"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:09.369179 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-15715fa7-7035-492c-bc05-e5125561e6b9 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9" status: 200 len: 636 microversion: 2.1 time: 0.133140 Nov 02 12:36:09.372104 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 186/385] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9 => generated 636 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:09.392826 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-71723ff9-2b3f-4d91-9677-9994af272119 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ccf6670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:09.474888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-71723ff9-2b3f-4d91-9677-9994af272119 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:09.479743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-71723ff9-2b3f-4d91-9677-9994af272119 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:09.556734 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-910d9abc-5c12-46b7-b94c-427233f322c6 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.218248 Nov 02 12:36:09.557983 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 200/386] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:09 2022] POST /compute/v2.1/flavors => generated 427 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:09.573541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cf302c84-cb74-4585-ab4d-dfdf37551a63 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.588798 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cf302c84-cb74-4585-ab4d-dfdf37551a63 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/341910778/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.022128 Nov 02 12:36:09.599661 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 201/387] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/flavors/341910778/os-flavor-access => generated 21 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:09.619787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:09.621780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:09.646898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.649869 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.651724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:09.654509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:09.656254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:09.656742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.034144 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:10.043807 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e6aaaa2-564f-4763-8d16-4af9d5c51dc4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.441998 Nov 02 12:36:10.044720 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 202/388] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:09 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:10.049580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ec0bf714-56d3-439e-94be-fd63d89b21e8 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:10.170716 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=10 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:10.597277 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-71723ff9-2b3f-4d91-9677-9994af272119 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 1.212054 Nov 02 12:36:10.598164 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 187/389] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:09 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:10.606327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:10.607111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:10.613861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.614354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.614793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.615500 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:10.615961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:10.616389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:10.762709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:10.771026 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9456a668-da58-4fc4-8b41-ba08621220ae tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.171843 Nov 02 12:36:10.771604 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 188/390] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:10 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:10.776184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bf178004-e6d5-49c3-8ff2-47ae161f58c8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd4b940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.005820 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ec0bf714-56d3-439e-94be-fd63d89b21e8 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/341910778" status: 202 len: 0 microversion: 2.1 time: 0.959717 Nov 02 12:36:11.008205 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 203/391] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:36:10 2022] DELETE /compute/v2.1/flavors/341910778 => generated 0 bytes in 962 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:11.025674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1f08b64e-e4bf-4f35-829b-702c8247c9c9 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.061625 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1f08b64e-e4bf-4f35-829b-702c8247c9c9 tempest-FlavorsAccessTestJSON-1941710636 tempest-FlavorsAccessTestJSON-1941710636-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044076 Nov 02 12:36:11.063381 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 204/392] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:11.068645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.071903 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:11.085949 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.086628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.087450 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.088896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.089537 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.092295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.238098 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bf178004-e6d5-49c3-8ff2-47ae161f58c8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "DELETE /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.463959 Nov 02 12:36:11.243225 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 189/393] 10.222.0.64 () {58 vars in 1296 bytes} [Wed Nov 2 12:36:10 2022] DELETE /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_version => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:11.252934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-13908de7-e3ca-41ec-bfd1-c637799c02dd tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd1e430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.325988 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-13908de7-e3ca-41ec-bfd1-c637799c02dd tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 37 microversion: 2.1 time: 0.073705 Nov 02 12:36:11.325988 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 190/394] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:11.332870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f1bba166-d488-4700-9a22-436f0f827285 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5cd4b0d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:11.466791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f1bba166-d488-4700-9a22-436f0f827285 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:11.472392 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f1bba166-d488-4700-9a22-436f0f827285 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:11.837018 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:11.860468 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f35c9ed2-70d3-4590-a31e-020e82c01126 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.792269 Nov 02 12:36:11.867522 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 205/395] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:11.896345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:11.899781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:11.916309 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.925523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.928805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:11.929767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:11.933330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:11.934154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.068275 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f1bba166-d488-4700-9a22-436f0f827285 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.740416 Nov 02 12:36:12.084992 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 191/396] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:11 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:12.101186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ab458ef3-4c86-417c-8db8-77f1a386f40d tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd4ba60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.192284 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ab458ef3-4c86-417c-8db8-77f1a386f40d tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.102619 Nov 02 12:36:12.213988 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 192/397] 10.222.0.64 () {58 vars in 1290 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_distro => generated 33 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:12.236509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c942281f-343b-46fc-9ad6-3618fcbac203 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ccb6af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:12.311646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:12.328679 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e01d46c0-0cd1-4adf-8648-e030d0e19d5a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.443071 Nov 02 12:36:12.332087 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 206/398] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:11 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:12.353868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c942281f-343b-46fc-9ad6-3618fcbac203 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:12.378938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c942281f-343b-46fc-9ad6-3618fcbac203 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:12.685561 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c942281f-343b-46fc-9ad6-3618fcbac203 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.469312 Nov 02 12:36:12.686177 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 193/399] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:12 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:12.698606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0581212d-7008-449b-b461-25527f238a17 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd04ee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.797069 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0581212d-7008-449b-b461-25527f238a17 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.102769 Nov 02 12:36:12.799341 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 207/400] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:12.813549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-551d53b4-0e05-46a1-ba2c-c7399807b752 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ceb8dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:12.920870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.925159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:12.945977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-551d53b4-0e05-46a1-ba2c-c7399807b752 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:12.947488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.951691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.951863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-551d53b4-0e05-46a1-ba2c-c7399807b752 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:12.957620 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.959356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.961051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.962159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.280778 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-551d53b4-0e05-46a1-ba2c-c7399807b752 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.475599 Nov 02 12:36:13.281403 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 194/401] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:12 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:13.293692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fc12cafe-82da-46b9-95b1-d93c74de4e93 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ceb8f70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:13.403403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:13.414344 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dcbacbf8-5b3f-44e0-a877-cf1868751361 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.509725 Nov 02 12:36:13.415101 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 208/402] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:13.428674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fc12cafe-82da-46b9-95b1-d93c74de4e93 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:13.436166 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fc12cafe-82da-46b9-95b1-d93c74de4e93 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:13.440849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:13.441850 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:13.450510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.451288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.452006 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.452929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.453623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.454272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.888896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:13.900100 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-622465c0-bcb5-404e-af5c-85ccd3f0b8bd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.469195 Nov 02 12:36:13.902572 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 209/403] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:13 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:14.206071 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fc12cafe-82da-46b9-95b1-d93c74de4e93 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.917745 Nov 02 12:36:14.206671 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 195/404] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:13 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 64 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:14.216820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1b30a4ac-9c71-4362-8c28-53a7501bca31 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cd1e160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.286308 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1b30a4ac-9c71-4362-8c28-53a7501bca31 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.073008 Nov 02 12:36:14.287703 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 196/405] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:36:14 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 64 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:14.299270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2c4099be-403c-4194-8879-56056fa8fa8c tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ce47e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:14.381840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-2c4099be-403c-4194-8879-56056fa8fa8c tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:14.390834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-2c4099be-403c-4194-8879-56056fa8fa8c tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:14.457465 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Action: 'update', calling method: .version_select at 0x7eff5d3a4790>, body: {"quota_set": {"ram": "5120"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:15.120218 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2c4099be-403c-4194-8879-56056fa8fa8c tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.824780 Nov 02 12:36:15.121128 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 197/406] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:14 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:15.135173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.135796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.143516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.144800 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.145473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.146611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.147316 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.147953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.561494 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.567186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.567725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.568663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.569122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.569554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.664794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:15.677960 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d29dff6b-b881-4ef9-923c-f035a39c10a2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.555162 Nov 02 12:36:15.681939 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 198/407] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:15.695092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c232408a-2db9-4b25-b804-8792615c1d99", "name": "network-vif-plugged", "status": "completed", "tag": "fb604afe-95f1-4593-9fa2-2ef9bef29837"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:15.724424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.727074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.727074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.747347 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] Creating event network-vif-plugged:fb604afe-95f1-4593-9fa2-2ef9bef29837 for instance c232408a-2db9-4b25-b804-8792615c1d99 on n-h1-857339-6 Nov 02 12:36:15.757641 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-288c978d-4c64-4303-b6b7-1b1406cee181 req-ff7fd691-d826-446a-b706-67f0cfbea100 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072865 Nov 02 12:36:15.760209 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 199/408] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:15.768558 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.770739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.790756 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e9f02d7b-41e8-49a6-ae90-ad299f9ac979 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713" status: 200 len: 240 microversion: 2.36 time: 1.879220 Nov 02 12:36:15.790756 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 210/409] 10.222.0.64 () {62 vars in 1303 bytes} [Wed Nov 2 12:36:13 2022] PUT /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713 => generated 240 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:15.795698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca7ffeb8-41b7-4845-8824-e021b4b44aca tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update', calling method: .version_select at 0x7eff5cc61dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:15.796405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.797428 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.798034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.798932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.799656 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.800246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.915073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-ca7ffeb8-41b7-4845-8824-e021b4b44aca tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:15.921518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-ca7ffeb8-41b7-4845-8824-e021b4b44aca tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:16.190003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.205883 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4e61784b-eee3-4ae2-96e7-938700ad3cb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1313 microversion: 2.1 time: 0.441529 Nov 02 12:36:16.219840 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 200/410] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:16.230442 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Calling method '.version_select at 0x7eff5ce47f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.657169 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca7ffeb8-41b7-4845-8824-e021b4b44aca tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.872224 Nov 02 12:36:16.659234 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 211/411] 10.222.0.64 () {60 vars in 1313 bytes} [Wed Nov 2 12:36:15 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata/os_version => generated 31 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:16.674245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eef635e1-3c6e-4ba6-8042-56088beeb9fa tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cc61f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.737761 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eef635e1-3c6e-4ba6-8042-56088beeb9fa tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 58 microversion: 2.1 time: 0.072868 Nov 02 12:36:16.739598 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 212/412] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 58 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:16.751374 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.752731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.760064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:16.779337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.780161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.781788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.784002 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.786316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.787126 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.823239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.825916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.826847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.827883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.829356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.830100 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.865936 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af1668f5-5804-4d5f-9588-e61bc1a579b5 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713/detail" status: 200 len: 672 microversion: 2.36 time: 0.644885 Nov 02 12:36:16.869992 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 201/413] 10.222.0.64 () {60 vars in 1304 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713/detail => generated 672 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:16.882145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c2383b15-4ee6-4d25-a496-016e255ae5d8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'update_all', calling method: .version_select at 0x7eff5ccf6280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:16.975379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c2383b15-4ee6-4d25-a496-016e255ae5d8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:16.992372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c2383b15-4ee6-4d25-a496-016e255ae5d8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:17.101491 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:17.119364 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0ff15292-3854-4170-9f0c-cd4a795dddeb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.377492 Nov 02 12:36:17.120059 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 213/414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:17.646349 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d07bd2fc-bea0-43db-b30d-87692f10637a tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1437541415", "id": 585485629, "os-flavor-access:is_public": "False"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:17.778231 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d07bd2fc-bea0-43db-b30d-87692f10637a tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.654383 Nov 02 12:36:17.779932 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 214/415] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:17 2022] POST /compute/v2.1/flavors => generated 436 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:17.793619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:17.795925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:17.806436 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c2383b15-4ee6-4d25-a496-016e255ae5d8 tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.926776 Nov 02 12:36:17.806436 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 202/416] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:16 2022] PUT /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 61 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:17.810059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-92446df6-c40e-435f-a6d2-7af3f0067b41 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:17.815426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.816213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.816877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.818598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.819132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.819648 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.107188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.118981 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3dadc75f-c13e-4bb9-8046-3a44c7aba144 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1463 microversion: 2.1 time: 0.336649 Nov 02 12:36:18.119651 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 215/417] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:17 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1463 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:18.140964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-269a91f2-3e34-485f-8b61-c68e653449ff tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Action: 'create', calling method: .version_select at 0x7eff5cbe7940>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:18.162791 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-92446df6-c40e-435f-a6d2-7af3f0067b41 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/585485629/action" status: 200 len: 96 microversion: 2.1 time: 0.360990 Nov 02 12:36:18.169211 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 203/418] 10.222.0.64 () {60 vars in 1197 bytes} [Wed Nov 2 12:36:17 2022] POST /compute/v2.1/flavors/585485629/action => generated 96 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:18.187844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c15163-d75c-45bd-8a07-f7d7b7d37455", "name": "network-vif-plugged", "status": "completed", "tag": "4fd2315f-3bee-4c55-9a39-5f59138d2385"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:18.213057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.215144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.215818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.241729 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] Creating event network-vif-plugged:4fd2315f-3bee-4c55-9a39-5f59138d2385 for instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 on n-h1-857339-6 Nov 02 12:36:18.263713 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-3b1cee81-635a-44e2-9169-b1abd38e14ae req-59c4bd00-873c-447b-9ef7-672923965153 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086361 Nov 02 12:36:18.266017 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 204/419] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:18.278801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Action: 'update', calling method: .version_select at 0x7eff5ccf6790>, body: {"quota_set": {"ram": "2048"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:18.325684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-269a91f2-3e34-485f-8b61-c68e653449ff tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:18.342783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-269a91f2-3e34-485f-8b61-c68e653449ff tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Getting quotas for user 8eff673925504edf86484a0f83ef314d and project 3097fd43fc3e4c328501a737f763386b. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:18.812108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.815132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.824644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.824644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.824644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.824644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.945479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.947544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.948061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.948963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.949430 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.949866 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.233241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:19.244809 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7c25eccd-f703-4af3-9c1e-398ee18739e9 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713?user_id=4ef257fd6b714fc9819d8ec0d5b1d377" status: 200 len: 240 microversion: 2.36 time: 0.974552 Nov 02 12:36:19.246541 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 205/420] 10.222.0.64 () {62 vars in 1384 bytes} [Wed Nov 2 12:36:18 2022] PUT /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713?user_id=4ef257fd6b714fc9819d8ec0d5b1d377 => generated 240 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:19.251278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.252226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.263059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.263618 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.264067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.264904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.265443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.265932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.321380 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-269a91f2-3e34-485f-8b61-c68e653449ff tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "POST /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 85 microversion: 2.1 time: 1.197540 Nov 02 12:36:19.329084 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 216/421] 10.222.0.64 () {60 vars in 1281 bytes} [Wed Nov 2 12:36:18 2022] POST /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 85 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:19.476302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.497201 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b8ad30a-7916-49f0-8e5d-48d3cb7306a6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1313 microversion: 2.1 time: 0.249873 Nov 02 12:36:19.511347 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 206/422] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:19.518617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f5252c74-f585-4144-93cf-a49f2ae11a27 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:19.579967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.602599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'deleted': False, 'project_id': '6d61f8d464244db0af7240cab16d8363'} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:19.616418 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.617271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.618096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.619131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.620288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.621865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.792290 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f676fc9b-cabc-4ba8-868a-f6fbcdc70a1f tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.461959 Nov 02 12:36:19.792943 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 217/423] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:19.810478 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f5252c74-f585-4144-93cf-a49f2ae11a27 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] HTTP exception thrown: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f5252c74-f585-4144-93cf-a49f2ae11a27 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Request method failure captured: Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/flavors/585485629/action HTTP/1.1 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 67 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQ_vsPqiBEPGyEGH1dBTjQw4amd_kOm0nA_Gmxs-IvrAbLvXuQ4Wy-JFsWXzJqrlU7xeWnySmr8K1zRtGuvtObXVPr_6CeouyevGQfTt333XRB4nCbpgVeQWj2ZWK6egAdJF7E0D2om46SMSPVYlOuzwvJhEFbdkPOw-EpwuyKpXfY Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:36:19.834193 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9d8803b6148448a292a9630bf910e955", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9d8803b6148448a292a9630bf910e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}] Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 54a6e19879ea4b0ba89285389de28113 Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} Nov 02 12:36:19.835435 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: exception: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '585485629', 'body': {'addTenantAccess': {'tenant': 'c8cc1940b87d4d5480b134a548aeee88'}}} Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:36:19.836106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '30-c8cc1940b87d4d5480b134a548aeee88' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi project.save(context.session) Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:36:19.837226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:36:19.838281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:36:19.842283 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '30-c8cc1940b87d4d5480b134a548aeee88' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 36, 19, 749291), 'updated_at': None, 'flavor_id': 30, 'project_id': 'c8cc1940b87d4d5480b134a548aeee88'}] Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:19.844373 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:19.846288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:19.849401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:19.851767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. Nov 02 12:36:19.851767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:19.851767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f5252c74-f585-4144-93cf-a49f2ae11a27 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Returning 409 to user: Flavor access already exists for flavor 30 and project c8cc1940b87d4d5480b134a548aeee88 combination. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:19.851767 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f5252c74-f585-4144-93cf-a49f2ae11a27 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/585485629/action" status: 409 len: 152 microversion: 2.1 time: 0.323309 Nov 02 12:36:19.851767 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 207/424] 10.222.0.64 () {60 vars in 1197 bytes} [Wed Nov 2 12:36:19 2022] POST /compute/v2.1/flavors/585485629/action => generated 152 bytes in 324 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:19.859664 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5617a831-3290-477f-94a5-5b95d68ec5a0 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] Calling method '.version_select at 0x7eff5cee3d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.020879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-28373d67-f9a3-4ca8-8612-1e056071b579 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.033958 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-28373d67-f9a3-4ca8-8612-1e056071b579 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.239909 Nov 02 12:36:20.038052 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 218/425] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:20.050557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8a06800f-787e-4401-916f-5b1b7115d5ae tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] Calling method '.version_select at 0x7eff5cc61ee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.121474 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8a06800f-787e-4401-916f-5b1b7115d5ae tempest-ImagesMetadataTestJSON-869415309 tempest-ImagesMetadataTestJSON-869415309-project] 10.222.0.64 "GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata" status: 200 len: 85 microversion: 2.1 time: 0.082039 Nov 02 12:36:20.122524 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 219/426] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/images/d35170e1-9818-4f52-9992-d6564ff50dd9/metadata => generated 85 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:20.131276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.137508 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'deleted': False} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:20.143560 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.144647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.151014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.151014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.151014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.151014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.260262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.multi_cell_list [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=127767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:20.334519 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:20.384140 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5617a831-3290-477f-94a5-5b95d68ec5a0 tempest-QuotasAdminTestV236-146886149 tempest-QuotasAdminTestV236-146886149-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713?user_id=4ef257fd6b714fc9819d8ec0d5b1d377" status: 200 len: 282 microversion: 2.36 time: 0.546550 Nov 02 12:36:20.385911 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 208/427] 10.222.0.64 () {60 vars in 1364 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/os-quota-sets/cafd86958ba84cacb2d51000dbb0f713?user_id=4ef257fd6b714fc9819d8ec0d5b1d377 => generated 282 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:20.399536 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66c88895-60bf-47a8-8361-837d4c08206c tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:20.512322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.513881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.517387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.275773 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-522ed984-0861-4f03-898d-221623b8533c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 7881 microversion: 2.1 time: 1.151923 Nov 02 12:36:21.276415 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 220/428] 10.222.0.64 () {58 vars in 1171 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 7881 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:21.389323 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66c88895-60bf-47a8-8361-837d4c08206c tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/585485629/action" status: 200 len: 21 microversion: 2.1 time: 1.000452 Nov 02 12:36:21.394550 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 209/429] 10.222.0.64 () {60 vars in 1197 bytes} [Wed Nov 2 12:36:20 2022] POST /compute/v2.1/flavors/585485629/action => generated 21 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:21.600589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-59991528-4226-4fe1-861a-3d2560828b8a tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1204241570", "id": 2059587386, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:21.739993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b2e2b123-2968-4076-ae40-afdf66a8e600 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2019859473", "id": 1563305278, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:21.818124 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-59991528-4226-4fe1-861a-3d2560828b8a tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.540594 Nov 02 12:36:21.818733 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 221/430] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:21 2022] POST /compute/v2.1/flavors => generated 425 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:21.825666 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.825666 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.833206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.833780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.834402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.835133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.835591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.836245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.945908 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b2e2b123-2968-4076-ae40-afdf66a8e600 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.553506 Nov 02 12:36:21.947037 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 210/431] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:36:21 2022] POST /compute/v2.1/flavors => generated 468 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:21.951594 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.957763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'deleted': False, 'project_id': '6d61f8d464244db0af7240cab16d8363'} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:21.964208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.964755 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.965206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.965933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.966387 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.966808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.988106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.997959 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-870c8ce6-6cab-4c61-a38a-c6b78b7c03c3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1463 microversion: 2.1 time: 0.178110 Nov 02 12:36:21.998550 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 222/432] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:22.017296 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-96827d24-cef4-4188-8766-529aea240800 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.072768 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-435bf2fd-7363-4729-8f5e-21d014ac5592 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail?tenant_id=6e09079e89384417879f678c0a4df5c2" status: 200 len: 15 microversion: 2.1 time: 0.125250 Nov 02 12:36:22.073933 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 211/433] 10.222.0.64 () {58 vars in 1231 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/detail?tenant_id=6e09079e89384417879f678c0a4df5c2 => generated 15 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:22.078512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a99e2067-668f-46c4-837d-a4fad1b24be5 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.086098 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a99e2067-668f-46c4-837d-a4fad1b24be5 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011101 Nov 02 12:36:22.088280 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 212/434] 10.222.0.64 () {58 vars in 1182 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:22.165020 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-96827d24-cef4-4188-8766-529aea240800 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/585485629" status: 202 len: 0 microversion: 2.1 time: 0.151942 Nov 02 12:36:22.165633 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 223/435] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:36:21 2022] DELETE /compute/v2.1/flavors/585485629 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:22.172123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:22.174834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:22.182352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.183386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.183813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.184580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.185184 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.185979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.319696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-262a1a92-6a53-436c-a345-63df16db86f9 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.331321 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-262a1a92-6a53-436c-a345-63df16db86f9 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] 10.222.0.64 "GET /compute/v2.1/flavors/1563305278" status: 200 len: 468 microversion: 2.61 time: 0.243094 Nov 02 12:36:22.332408 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 213/436] 10.222.0.64 () {60 vars in 1199 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/1563305278 => generated 468 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:22.337450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.345686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'tenant_id': '6e09079e89384417879f678c0a4df5c2', 'deleted': False} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:22.351528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.352237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.352867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.353805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.354951 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.355530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b434a4-c338-4b14-9ce5-25b16a843619) Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:36:22.409074 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:22.410305 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:22.411394 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b434a4-c338-4b14-9ce5-25b16a843619) Nov 02 12:36:22.412330 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.416340 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:22.416340 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:22.423963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.multi_cell_list [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=127766) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455/action HTTP/1.1 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 32 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:22.424950 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: {"resize": {"flavorRef": "451"}} Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:22.426217 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '99c15163-d75c-45bd-8a07-f7d7b7d37455', 'body': {'resize': {'flavorRef': '451'}}} Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:22.426933 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:22.427929 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:22.429096 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68b434a4-c338-4b14-9ce5-25b16a843619) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:22.430016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.430917 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.433782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:22.433782 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:22.441775 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c3553adb-7c5d-4cce-a3d0-98b99206f7f4 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455/action" status: 500 len: 214 microversion: 2.1 time: 0.275049 Nov 02 12:36:22.447512 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 224/437] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:22 2022] POST /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455/action => generated 214 bytes in 281 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:36:22.459981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5cd73646-3807-4fde-a3d9-986579d2412e tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1044705974", "id": 1719706571, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:22.639070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.639724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.640179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.652779 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5cd73646-3807-4fde-a3d9-986579d2412e tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.203546 Nov 02 12:36:22.654511 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 225/438] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:22 2022] POST /compute/v2.1/flavors => generated 425 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:22.674399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-64f5696d-0898-4d22-94d7-e6a60514d1d7 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.697998 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-64f5696d-0898-4d22-94d7-e6a60514d1d7 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6239 microversion: 2.1 time: 0.042145 Nov 02 12:36:22.698598 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 226/439] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/detail => generated 6239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:22.703386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e020502d-515c-4b7e-bcaa-8c1857819236 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:22.847856 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e020502d-515c-4b7e-bcaa-8c1857819236 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] 10.222.0.64 "PUT /compute/v2.1/flavors/1563305278" status: 200 len: 469 microversion: 2.61 time: 0.147972 Nov 02 12:36:22.848857 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 227/440] 10.222.0.64 () {62 vars in 1219 bytes} [Wed Nov 2 12:36:22 2022] PUT /compute/v2.1/flavors/1563305278 => generated 469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:22.855501 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87fa3a62-20ed-4b23-a31d-a8b3fbbe6e18 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.865745 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-87fa3a62-20ed-4b23-a31d-a8b3fbbe6e18 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015257 Nov 02 12:36:22.866495 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 228/441] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:22.880532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-63317e18-d090-46eb-8ff5-016554fc5f85 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.889428 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-63317e18-d090-46eb-8ff5-016554fc5f85 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012630 Nov 02 12:36:22.890530 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 229/442] 10.222.0.64 () {58 vars in 1182 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:22.906156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8a846511-a055-4633-9578-332b00ae17db tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1662196742", "id": 915561290, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:22.920612 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-28772ee0-6b17-489f-9520-ef673a39f3ec tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e09079e89384417879f678c0a4df5c2" status: 200 len: 4825 microversion: 2.1 time: 0.586808 Nov 02 12:36:22.928638 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 214/443] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6e09079e89384417879f678c0a4df5c2 => generated 4825 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:22.932960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d3159b3b-390d-4e81-a725-177164cf9206 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.959345 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d3159b3b-390d-4e81-a725-177164cf9206 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 7160 microversion: 2.61 time: 0.036539 Nov 02 12:36:22.959845 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 215/444] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/flavors/detail => generated 7160 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:22.965375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eac1b875-2eba-4d8b-8c3d-8b2d61756348 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1658655552", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:23.038283 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8a846511-a055-4633-9578-332b00ae17db tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.145913 Nov 02 12:36:23.038895 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 230/445] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:22 2022] POST /compute/v2.1/flavors => generated 435 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:23.045876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f6c3a62e-df5d-4d09-93b2-1c11938a35b1 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Action: 'create', calling method: .version_select at 0x7eff5c915e50>, body: {"keypair": {"name": "tempest-keypair-601079759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeBMHFeJSmkfGMQcOlmrBMKK7cghJEka6fqIWepZQvAPSPMBuUVB5j+Sp0rKaBU6/S+XIm0YrCSAyblYPV4l2HWUPH3UQvbwMV6rPRO2J5RJimOqQYO/EAHrfhm/IKo6w=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:23.072934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-f6c3a62e-df5d-4d09-93b2-1c11938a35b1 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Getting quotas for project 4589769481b746e7bd703f2d34706a67. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:23.072934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-f6c3a62e-df5d-4d09-93b2-1c11938a35b1 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Getting quotas for user da25c954869747feba32b67010ae303f and project 4589769481b746e7bd703f2d34706a67. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:23.130054 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eac1b875-2eba-4d8b-8c3d-8b2d61756348 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.168880 Nov 02 12:36:23.130652 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 216/446] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Nov 2 12:36:22 2022] POST /compute/v2.1/flavors => generated 499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:23.145920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.157509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'tenant_id': '6d61f8d464244db0af7240cab16d8363', 'deleted': False} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:23.168302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.169178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.169515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.170388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.170703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.171155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.220196 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dbc87b4d-e934-4c19-9410-576e4bccb48c tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d61f8d464244db0af7240cab16d8363" status: 200 len: 15 microversion: 2.1 time: 0.088000 Nov 02 12:36:23.221250 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 217/447] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6d61f8d464244db0af7240cab16d8363 => generated 15 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:23.228510 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-04fc7d4a-051b-4085-a9dc-08ab58b32a43 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.238227 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f6c3a62e-df5d-4d09-93b2-1c11938a35b1 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.197811 Nov 02 12:36:23.239187 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 231/448] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:36:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:23.244387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-83e5b0be-c0fc-4c44-8dff-4216fea5b144 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.252626 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-83e5b0be-c0fc-4c44-8dff-4216fea5b144 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] HTTP exception thrown: Access list not available for public flavors. Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-83e5b0be-c0fc-4c44-8dff-4216fea5b144 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Request method failure captured: Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/flavors/915561290/os-flavor-access HTTP/1.1 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQ_vsPqiBEPGyEGH1dBTjQw4amd_kOm0nA_Gmxs-IvrAbLvXuQ4Wy-JFsWXzJqrlU7xeWnySmr8K1zRtGuvtObXVPr_6CeouyevGQfTt333XRB4nCbpgVeQWj2ZWK6egAdJF7E0D2om46SMSPVYlOuzwvJhEFbdkPOw-EpwuyKpXfY Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:36:23.255451 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9d8803b6148448a292a9630bf910e955", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9d8803b6148448a292a9630bf910e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}] Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 54a6e19879ea4b0ba89285389de28113 Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: exception: Access list not available for public flavors. Nov 02 12:36:23.256717 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'flavor_id': '915561290'} Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Nov 02 12:36:23.257358 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:23.261358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-83e5b0be-c0fc-4c44-8dff-4216fea5b144 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:23.262461 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-83e5b0be-c0fc-4c44-8dff-4216fea5b144 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/915561290/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.022148 Nov 02 12:36:23.263630 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 232/449] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/flavors/915561290/os-flavor-access => generated 91 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:23.268900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad0e0303-7d38-4822-a678-8e82421269e4 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.280111 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-04fc7d4a-051b-4085-a9dc-08ab58b32a43 tempest-FlavorsV261TestJSON-993706717 tempest-FlavorsV261TestJSON-993706717-project] 10.222.0.64 "GET /compute/v2.1/flavors" status: 200 len: 4301 microversion: 2.61 time: 0.052744 Nov 02 12:36:23.280111 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 218/450] 10.222.0.64 () {60 vars in 1166 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/flavors => generated 4301 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:23.281749 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ad0e0303-7d38-4822-a678-8e82421269e4 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016772 Nov 02 12:36:23.282511 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 233/451] 10.222.0.64 () {58 vars in 1182 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:23.287069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-32c931b0-9f89-4b49-9667-7adfaf410d2b tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.296144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a5ce9218-7f0f-49fa-b33d-da45098af84a tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.313092 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a5ce9218-7f0f-49fa-b33d-da45098af84a tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.034339 Nov 02 12:36:23.313979 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 219/452] 10.222.0.64 () {58 vars in 1189 bytes} [Wed Nov 2 12:36:23 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:23.319285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9dd59088-67c3-4ab2-84ce-4ffbd7968771 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:23.435127 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-32c931b0-9f89-4b49-9667-7adfaf410d2b tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/915561290" status: 202 len: 0 microversion: 2.1 time: 0.145996 Nov 02 12:36:23.440253 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 234/453] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:36:23 2022] DELETE /compute/v2.1/flavors/915561290 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:23.442249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:23.446278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:23.456992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.457520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.461172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.461172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.461172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.461172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.497145 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9dd59088-67c3-4ab2-84ce-4ffbd7968771 tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1563305278" status: 202 len: 0 microversion: 2.61 time: 0.181905 Nov 02 12:36:23.497920 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 220/454] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Nov 2 12:36:23 2022] DELETE /compute/v2.1/flavors/1563305278 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:23.503105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1337208615", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "0a129016-013e-45c6-922e-8a26e195bed7"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:23.560445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:23.902802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:23.903455 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:23.904410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:23.904977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:23.905586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:23.916180 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.917256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.917666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.922156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:23.923094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:23.923730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:23.946115 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:23.952870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for user 976993a09f2342c68dab07da6a7dd236 and project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:23.971251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:36:23.973825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:36:24.129591 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7ec80463-b824-4f57-8c6f-86185aa2d272 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 0 microversion: 2.1 time: 0.690986 Nov 02 12:36:24.138687 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 235/455] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:23 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 0 bytes in 701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:24.147393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37d1c568-8205-4ce4-9bd9-41d4635e84f2 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.147521 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c96a296c-56a3-44f2-a31d-63ef2bb1cd4d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646216 Nov 02 12:36:24.147521 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 221/456] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:36:24.162806 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3d51780f-a0f8-451d-8c32-04ba3d60986e tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.168101 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37d1c568-8205-4ce4-9bd9-41d4635e84f2 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6310 microversion: 2.1 time: 0.028139 Nov 02 12:36:24.169300 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 236/457] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/flavors/detail => generated 6310 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:24.174420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.181196 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.182110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6e09079e89384417879f678c0a4df5c2'} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:24.190311 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.195457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.196115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.197174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.197802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.198964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.213258 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3d51780f-a0f8-451d-8c32-04ba3d60986e tempest-FlavorsV261TestJSON-2090597482 tempest-FlavorsV261TestJSON-2090597482-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 7230 microversion: 2.61 time: 0.065920 Nov 02 12:36:24.230636 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 222/458] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/flavors/detail => generated 7230 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:24.237837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a8bd65e8-7a7a-42c6-89f9-673eeb8587a5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.238617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a8bd65e8-7a7a-42c6-89f9-673eeb8587a5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.297191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a8bd65e8-7a7a-42c6-89f9-673eeb8587a5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:24.305226 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a8bd65e8-7a7a-42c6-89f9-673eeb8587a5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1279 microversion: 2.1 time: 0.074170 Nov 02 12:36:24.306141 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 223/459] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1279 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:24.308987 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.multi_cell_list [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:24.321239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9a5191f8-5826-4c1e-8ec6-0e393e0313af tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-417427634", "id": 1552285394, "os-flavor-access:is_public": "False"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:24.385967 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d3927dcd-d9d2-48aa-b630-17b341ebafb9 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.215254 Nov 02 12:36:24.394229 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 237/460] 10.222.0.64 () {58 vars in 1150 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:24.399271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:24.402799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.410414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.410414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.410838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.411533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.411982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.412408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.440996 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9a5191f8-5826-4c1e-8ec6-0e393e0313af tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.133641 Nov 02 12:36:24.441636 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 224/461] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:24 2022] POST /compute/v2.1/flavors => generated 438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:24.975768 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-281763c5-9639-436f-8eb3-7f107a3aab25 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 0 microversion: 2.1 time: 0.580287 Nov 02 12:36:24.977685 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 238/462] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:24 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:24.987155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.987784 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.994561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.995055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.995515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.996247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.996754 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.997224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.197103 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-10c6c970-e592-4bb1-b608-a60b2bd57a10 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1613 microversion: 2.1 time: 0.213627 Nov 02 12:36:25.214504 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 239/463] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1613 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:25.226186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.226806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.234359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.234847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.238077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.238077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.238077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.238077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.315528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-df599ad8-b697-4f2a-a325-b1313a54b243 tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.320375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-df599ad8-b697-4f2a-a325-b1313a54b243 tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '435baaf87c8e4ca0ae97521176e988b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cc1940b87d4d5480b134a548aeee88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-df599ad8-b697-4f2a-a325-b1313a54b243 tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Request method failure captured: Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/flavors/1552285394/action HTTP/1.1 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 67 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQ8Fo4jloZ0Wu75Y-eO955DtE6z__OgYdIU_zuf3qXrK2XBuxp4FD_r-VzWwhz_NdftZpF-usxperJpoygEvndEMu6XKgro_7A8lqZdQvnd6qf37nkB6v8D35VgKupm69KPTcjBrAeQIsvrSvS1SC3AfOz9pOurXxuUfzlcJP_61zI Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: c8cc1940b87d4d5480b134a548aeee88 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:25.322055 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c8cc1940b87d4d5480b134a548aeee88", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c8cc1940b87d4d5480b134a548aeee88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c8cc1940b87d4d5480b134a548aeee88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c8cc1940b87d4d5480b134a548aeee88"}]}] Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: c8cc1940b87d4d5480b134a548aeee88 Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FlavorsAccessNegativeTestJSON-239931915-project Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 435baaf87c8e4ca0ae97521176e988b2 Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-239931915-project Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} Nov 02 12:36:25.323823 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '1552285394', 'body': {'addTenantAccess': {'tenant': 'c8cc1940b87d4d5480b134a548aeee88'}}} Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:36:25.324618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Nov 02 12:36:25.325670 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.326760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-df599ad8-b697-4f2a-a325-b1313a54b243 tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.326760 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-df599ad8-b697-4f2a-a325-b1313a54b243 tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] 10.222.0.64 "POST /compute/v2.1/flavors/1552285394/action" status: 403 len: 130 microversion: 2.1 time: 0.873771 Nov 02 12:36:25.328694 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 225/464] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:24 2022] POST /compute/v2.1/flavors/1552285394/action => generated 130 bytes in 879 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:36:25.334675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ee9db2b-2da6-4cef-bc61-dfa18ba138b8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.335448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8ee9db2b-2da6-4cef-bc61-dfa18ba138b8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.448532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8ee9db2b-2da6-4cef-bc61-dfa18ba138b8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:25.449751 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82fac3f0-3f09-4177-8246-d631267a84de tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1613 microversion: 2.1 time: 0.227216 Nov 02 12:36:25.450396 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 240/465] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1613 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.456425 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-858fa00f-cc67-44eb-bfd1-b9b6b9128adb tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.468955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:25.481409 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8ee9db2b-2da6-4cef-bc61-dfa18ba138b8 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1279 microversion: 2.1 time: 0.151214 Nov 02 12:36:25.482080 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 226/466] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.487350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.494033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'host': 'n-h1-857339-6', 'deleted': False} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:25.515424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.515927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.516395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.517630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.518101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.518805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.610304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.multi_cell_list [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=127766) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:36:25.674849 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8cccb124-192f-4d49-b58c-01c7ccfdec99 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers?host=n-h1-857339-6&all_tenants=1" status: 200 len: 1312 microversion: 2.1 time: 0.191315 Nov 02 12:36:25.675582 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 227/467] 10.222.0.64 () {58 vars in 1190 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers?host=n-h1-857339-6&all_tenants=1 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.688518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.694708 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:36:25.705516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.706032 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.706469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.719319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.719319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.719319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.728093 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dbb3d4e8-80b9-43c1-80eb-dc38e392967b tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.043206 Nov 02 12:36:25.728707 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 228/468] 10.222.0.64 () {58 vars in 1196 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:25.740737 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:25.742910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.749394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.749864 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.750297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.750968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.751438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.751871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.753893 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-858fa00f-cc67-44eb-bfd1-b9b6b9128adb tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1552285394" status: 202 len: 0 microversion: 2.1 time: 0.302145 Nov 02 12:36:25.754557 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 241/469] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:25 2022] DELETE /compute/v2.1/flavors/1552285394 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:25.763521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bc345776-3cbb-4bae-989d-eb3e1d093468 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.789363 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bc345776-3cbb-4bae-989d-eb3e1d093468 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6310 microversion: 2.1 time: 0.030396 Nov 02 12:36:25.801280 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 242/470] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/flavors/detail => generated 6310 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:25.812538 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a4437b82-289a-4afe-98f3-0b3b3a35e176 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1883436039", "id": 1047600634, "os-flavor-access:is_public": "False"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.018811 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a4437b82-289a-4afe-98f3-0b3b3a35e176 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.209724 Nov 02 12:36:26.028042 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 243/471] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/flavors => generated 439 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:26.034364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-74fb16fb-0ee4-4833-b6e3-5934a5f7969e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.639318 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-74fb16fb-0ee4-4833-b6e3-5934a5f7969e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1047600634/action" status: 200 len: 97 microversion: 2.1 time: 0.607687 Nov 02 12:36:26.639318 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 244/472] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/flavors/1047600634/action => generated 97 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:26.648375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:26.649334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.656320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.656921 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.657564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.658271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.658771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.659410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.728044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.736055 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5d60954f-928e-49a9-87e4-a65632cd32ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1283 microversion: 2.1 time: 0.097230 Nov 02 12:36:26.736690 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 245/473] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:26 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:26.752231 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8c6f9a19-c97a-4a15-b10c-c27be99226b3 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 0 microversion: 2.1 time: 1.014079 Nov 02 12:36:26.754172 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 229/474] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:25 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:36:26.756030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-25323386-871e-48e7-9ca0-74ed38c6d7ed tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.764944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-25323386-871e-48e7-9ca0-74ed38c6d7ed tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '435baaf87c8e4ca0ae97521176e988b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8cc1940b87d4d5480b134a548aeee88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-25323386-871e-48e7-9ca0-74ed38c6d7ed tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Request method failure captured: Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/flavors/1047600634/action HTTP/1.1 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 70 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQ8Fo4jloZ0Wu75Y-eO955DtE6z__OgYdIU_zuf3qXrK2XBuxp4FD_r-VzWwhz_NdftZpF-usxperJpoygEvndEMu6XKgro_7A8lqZdQvnd6qf37nkB6v8D35VgKupm69KPTcjBrAeQIsvrSvS1SC3AfOz9pOurXxuUfzlcJP_61zI Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: c8cc1940b87d4d5480b134a548aeee88 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:26.770288 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c8cc1940b87d4d5480b134a548aeee88", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c8cc1940b87d4d5480b134a548aeee88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c8cc1940b87d4d5480b134a548aeee88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c8cc1940b87d4d5480b134a548aeee88"}]}] Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: c8cc1940b87d4d5480b134a548aeee88 Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-239931915 Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsAccessNegativeTestJSON-239931915-project Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 435baaf87c8e4ca0ae97521176e988b2 Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-239931915-project Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: {"removeTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} Nov 02 12:36:26.771540 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1047600634', 'body': {'removeTenantAccess': {'tenant': 'c8cc1940b87d4d5480b134a548aeee88'}}} Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can( Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:36:26.772216 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Nov 02 12:36:26.773357 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:26.776876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-25323386-871e-48e7-9ca0-74ed38c6d7ed tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:26.776876 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-25323386-871e-48e7-9ca0-74ed38c6d7ed tempest-FlavorsAccessNegativeTestJSON-239931915 tempest-FlavorsAccessNegativeTestJSON-239931915-project] 10.222.0.64 "POST /compute/v2.1/flavors/1047600634/action" status: 403 len: 133 microversion: 2.1 time: 0.034151 Nov 02 12:36:26.776876 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 246/475] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/flavors/1047600634/action => generated 133 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:26.777200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.779727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.785415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11a3ab6b-372e-45c4-8306-ed6515bca58e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c8cc1940b87d4d5480b134a548aeee88"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.798665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.799381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.800119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.802134 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.802786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.803242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.828426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:26.898530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:26.899043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:26.899695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:26.900065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:26.900635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:27.320834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.343085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.356549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.357543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.358562 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.359377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.360056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.398617 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b2e2a541-aee6-4cc3-a262-a21baf9fdfad tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 1066 microversion: 2.1 time: 0.637578 Nov 02 12:36:27.399306 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 230/476] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 1066 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:36:27.417791 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-11a3ab6b-372e-45c4-8306-ed6515bca58e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1047600634/action" status: 200 len: 21 microversion: 2.1 time: 0.635020 Nov 02 12:36:27.418462 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 247/477] 10.222.0.64 () {60 vars in 1200 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/flavors/1047600634/action => generated 21 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:27.423336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.423940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.430015 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.430541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.430934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.431622 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.432068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.432548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.580447 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.588731 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d9113054-b789-462c-ab05-a1451fa8d104 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.169036 Nov 02 12:36:27.590110 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 248/478] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.628821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d70af03-c39b-4a49-859e-15ae3e52fdb4 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.784471 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1d70af03-c39b-4a49-859e-15ae3e52fdb4 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1047600634" status: 202 len: 0 microversion: 2.1 time: 0.169889 Nov 02 12:36:27.795404 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 249/479] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:27 2022] DELETE /compute/v2.1/flavors/1047600634 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:27.802532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.806188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:27.830632 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.831342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.831916 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.832888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:27.833502 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:27.834116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:27.895175 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-73583b69-7955-4cdd-bdc9-ca5058bd10f9 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.489386 Nov 02 12:36:27.909632 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 231/480] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:36:27 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:36:27.929561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-696c0c26-36e0-4ed8-bd36-f74421825a0d tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:27.963204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:27.969241 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-696c0c26-36e0-4ed8-bd36-f74421825a0d tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6310 microversion: 2.1 time: 0.057904 Nov 02 12:36:27.974134 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 232/481] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/flavors/detail => generated 6310 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:27.990596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd584cf1-cbb0-46db-bb64-33abf4494bab tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Calling method '.version_select at 0x7eff5cd4baf0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.002363 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-91288a9c-21aa-4659-92c5-8ac2edb4e3cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1331 microversion: 2.1 time: 0.202777 Nov 02 12:36:28.008642 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 250/482] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:27 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1331 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:28.015637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cca66263-2b76-4387-89ea-a511d08ca974 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1842454778", "id": 326065558, "os-flavor-access:is_public": "False"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:28.070720 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-fd584cf1-cbb0-46db-bb64-33abf4494bab tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] HTTP exception thrown: Image not found. Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd584cf1-cbb0-46db-bb64-33abf4494bab tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Request method failure captured: Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRKLzYrdMkeN7PoXOOq_-538I8NuN1--2IVIFgIIuG-xA4crmJsKW_cJwo7HYVklE2jgP3tqDWeslH6kcpYhgWmbZs7IIuuzDu1LW7_ffTyeav09C2Kz97WvU_t-92dO7__vAo3IGixRVOX6roON5GzVjGI1O-BsP_LuMGCLI9yHcQ Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:28.074957 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_70a0a123c2f74bfeb12dec018ad0d4d7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}] Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b81c259b7cab41409e166497eb1c45d1 Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '-1'} Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.076625 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.077513 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.078731 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:36:28.080112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.083086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd584cf1-cbb0-46db-bb64-33abf4494bab tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.084364 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fd584cf1-cbb0-46db-bb64-33abf4494bab tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.108026 Nov 02 12:36:28.085617 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 233/483] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:36:27 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:28.100313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87acab4a-2995-4ba3-8a38-d80ec3243aad tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Calling method '.version_select at 0x7eff5c8753a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.136978 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cca66263-2b76-4387-89ea-a511d08ca974 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.127073 Nov 02 12:36:28.141523 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 251/484] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:28.159699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f33ea81c-9bdd-46f2-8433-f8878e648f69 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cbeb96e2a91146409a52a0d7fe233d45"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:28.166464 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-87acab4a-2995-4ba3-8a38-d80ec3243aad tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] HTTP exception thrown: Image not found. Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87acab4a-2995-4ba3-8a38-d80ec3243aad tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Request method failure captured: Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/images/823cec70-db75-42cd-b266-e4cde163720j HTTP/1.1 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRKLzYrdMkeN7PoXOOq_-538I8NuN1--2IVIFgIIuG-xA4crmJsKW_cJwo7HYVklE2jgP3tqDWeslH6kcpYhgWmbZs7IIuuzDu1LW7_ffTyeav09C2Kz97WvU_t-92dO7__vAo3IGixRVOX6roON5GzVjGI1O-BsP_LuMGCLI9yHcQ Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:28.168419 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_70a0a123c2f74bfeb12dec018ad0d4d7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}] Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b81c259b7cab41409e166497eb1c45d1 Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '823cec70-db75-42cd-b266-e4cde163720j'} Nov 02 12:36:28.169681 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 823cec70-db75-42cd-b266-e4cde163720j to delete Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.170393 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 823cec70-db75-42cd-b266-e4cde163720j could not be found. Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.171612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87acab4a-2995-4ba3-8a38-d80ec3243aad tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.172897 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-87acab4a-2995-4ba3-8a38-d80ec3243aad tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/823cec70-db75-42cd-b266-e4cde163720j" status: 404 len: 62 microversion: 2.1 time: 0.078169 Nov 02 12:36:28.179645 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 234/485] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:28 2022] DELETE /compute/v2.1/images/823cec70-db75-42cd-b266-e4cde163720j => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:36:28.211172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-445eb0a1-d4a6-4ec2-b4fc-810d2f481cdf tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Calling method '.version_select at 0x7eff5cd4bf70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.250574 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-445eb0a1-d4a6-4ec2-b4fc-810d2f481cdf tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] HTTP exception thrown: Image not found. Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-445eb0a1-d4a6-4ec2-b4fc-810d2f481cdf tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Request method failure captured: Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/images/a8e7f69f-331c-43f3-a108-35d49c8376991 HTTP/1.1 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRKLzYrdMkeN7PoXOOq_-538I8NuN1--2IVIFgIIuG-xA4crmJsKW_cJwo7HYVklE2jgP3tqDWeslH6kcpYhgWmbZs7IIuuzDu1LW7_ffTyeav09C2Kz97WvU_t-92dO7__vAo3IGixRVOX6roON5GzVjGI1O-BsP_LuMGCLI9yHcQ Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:28.254570 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_70a0a123c2f74bfeb12dec018ad0d4d7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}] Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b81c259b7cab41409e166497eb1c45d1 Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'a8e7f69f-331c-43f3-a108-35d49c8376991'} Nov 02 12:36:28.256454 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a8e7f69f-331c-43f3-a108-35d49c8376991 to delete Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.265166 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a8e7f69f-331c-43f3-a108-35d49c8376991 could not be found. Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.266187 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-445eb0a1-d4a6-4ec2-b4fc-810d2f481cdf tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.267382 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-445eb0a1-d4a6-4ec2-b4fc-810d2f481cdf tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/a8e7f69f-331c-43f3-a108-35d49c8376991" status: 404 len: 62 microversion: 2.1 time: 0.068980 Nov 02 12:36:28.268279 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 235/486] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:28 2022] DELETE /compute/v2.1/images/a8e7f69f-331c-43f3-a108-35d49c8376991 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:28.277023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1888792547", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "1719706571", "adminPass": "***", "networks": [{"uuid": "4e21e97b-510c-44f1-81ec-8bd474cbbb71"}], "security_groups": [{"name": "tempest-securitygroup--1088133786"}], "key_name": "tempest-keypair-601079759", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:28.331105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:28.546163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] validate_networks() for [('4e21e97b-510c-44f1-81ec-8bd474cbbb71', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:28.548731 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-f33ea81c-9bdd-46f2-8433-f8878e648f69 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] HTTP exception thrown: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f33ea81c-9bdd-46f2-8433-f8878e648f69 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Request method failure captured: Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/flavors/326065558/action HTTP/1.1 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 70 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQ_vsPqiBEPGyEGH1dBTjQw4amd_kOm0nA_Gmxs-IvrAbLvXuQ4Wy-JFsWXzJqrlU7xeWnySmr8K1zRtGuvtObXVPr_6CeouyevGQfTt333XRB4nCbpgVeQWj2ZWK6egAdJF7E0D2om46SMSPVYlOuzwvJhEFbdkPOw-EpwuyKpXfY Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:36:28.550630 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9d8803b6148448a292a9630bf910e955", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9d8803b6148448a292a9630bf910e955"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9d8803b6148448a292a9630bf910e955"}]}] Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9d8803b6148448a292a9630bf910e955 Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931 Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 54a6e19879ea4b0ba89285389de28113 Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: {"removeTenantAccess": {"tenant": "cbeb96e2a91146409a52a0d7fe233d45"}} Nov 02 12:36:28.552108 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: exception: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '326065558', 'body': {'removeTenantAccess': {'tenant': 'cbeb96e2a91146409a52a0d7fe233d45'}}} Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Nov 02 12:36:28.552908 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.554153 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f33ea81c-9bdd-46f2-8433-f8878e648f69 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Returning 404 to user: Flavor access not found for 38 / cbeb96e2a91146409a52a0d7fe233d45 combination. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f33ea81c-9bdd-46f2-8433-f8878e648f69 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/326065558/action" status: 404 len: 124 microversion: 2.1 time: 0.405008 Nov 02 12:36:28.555262 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 252/487] 10.222.0.64 () {60 vars in 1197 bytes} [Wed Nov 2 12:36:28 2022] POST /compute/v2.1/flavors/326065558/action => generated 124 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:36:28.559878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0b2a7d7-67f2-4a23-857d-516f1a107084 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Calling method '.version_select at 0x7eff5c8c6b80>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.591812 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b0b2a7d7-67f2-4a23-857d-516f1a107084 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] HTTP exception thrown: Image not found. Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0b2a7d7-67f2-4a23-857d-516f1a107084 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Request method failure captured: Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/images/tempest-invalid-416955248 HTTP/1.1 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRKLzYrdMkeN7PoXOOq_-538I8NuN1--2IVIFgIIuG-xA4crmJsKW_cJwo7HYVklE2jgP3tqDWeslH6kcpYhgWmbZs7IIuuzDu1LW7_ffTyeav09C2Kz97WvU_t-92dO7__vAo3IGixRVOX6roON5GzVjGI1O-BsP_LuMGCLI9yHcQ Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:28.604762 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_70a0a123c2f74bfeb12dec018ad0d4d7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}] Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: b81c259b7cab41409e166497eb1c45d1 Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'tempest-invalid-416955248'} Nov 02 12:36:28.606081 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-416955248 to delete Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.606823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-416955248 could not be found. Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:28.607952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:36:28.609282 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:28.611590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0b2a7d7-67f2-4a23-857d-516f1a107084 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:28.618047 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b0b2a7d7-67f2-4a23-857d-516f1a107084 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/tempest-invalid-416955248" status: 404 len: 62 microversion: 2.1 time: 0.063799 Nov 02 12:36:28.619253 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 253/488] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:36:28 2022] DELETE /compute/v2.1/images/tempest-invalid-416955248 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:28.627853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f513ea50-0e24-4a1d-8321-70759491db17 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.753934 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f513ea50-0e24-4a1d-8321-70759491db17 tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/326065558" status: 202 len: 0 microversion: 2.1 time: 0.131657 Nov 02 12:36:28.759000 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 254/489] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:36:28 2022] DELETE /compute/v2.1/flavors/326065558 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:28.765650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:28.766631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:28.773880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.774831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.775518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:28.777218 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:28.777903 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:28.778530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-78f56c3a-cc15-4863-b556-5194050fd5d1) Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:29.108035 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.109432 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:29.110437 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:29.111740 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:29.113948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-78f56c3a-cc15-4863-b556-5194050fd5d1) Nov 02 12:36:29.113948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.113948 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:29.113948 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:29.114580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Request method failure captured: Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 505 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQx3HAZnwfgWRbFb3gJlZ_vamRxe3F2nS99_xa4Fgp1y1MhQZYioNqV0inuSTibpwSBAuP8RguoJNAfa4huCH2Qkpu_wKY3XrswnWRDOFDElCxK79h1ULaTUb53AFZQI5AqOaH2rd-1c9n7VLdE3P-9FE1YyivcDEF58idEchRYt9I Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4589769481b746e7bd703f2d34706a67 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-2042767784 Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:29.115069 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4589769481b746e7bd703f2d34706a67", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4589769481b746e7bd703f2d34706a67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4589769481b746e7bd703f2d34706a67"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4589769481b746e7bd703f2d34706a67"}]}] Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-2042767784 Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4589769481b746e7bd703f2d34706a67 Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-2042767784 Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersWithSpecificFlavorTestJSON-2042767784-project Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: da25c954869747feba32b67010ae303f Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-2042767784-project Nov 02 12:36:29.117940 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1888792547", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "1719706571", "adminPass": "password", "networks": [{"uuid": "4e21e97b-510c-44f1-81ec-8bd474cbbb71"}], "security_groups": [{"name": "tempest-securitygroup--1088133786"}], "key_name": "tempest-keypair-601079759", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersWithSpecificFlavorTestJSON-server-1888792547', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '1719706571', 'adminPass': 'password', 'networks': [{'uuid': '4e21e97b-510c-44f1-81ec-8bd474cbbb71'}], 'security_groups': [{'name': 'tempest-securitygroup--1088133786'}], 'key_name': 'tempest-keypair-601079759', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.120477 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:29.123475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:29.131475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:29.132508 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-78f56c3a-cc15-4863-b556-5194050fd5d1) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:36:29.133408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:29.134331 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:29.137811 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4fe75246-6ade-4c62-9508-1b333a1f824d tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.840672 Nov 02 12:36:29.137811 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 236/490] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 851 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:36:29.137811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1259a157-cfca-497c-ae8f-4f1dafa44224 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Calling method '.version_select at 0x7eff5c84adc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.138453 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b2d50ed8-570f-4855-9c7b-471ab16b3ae4 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.362623 Nov 02 12:36:29.138453 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 255/491] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:28 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:29.138453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b851bc35-b8d5-447c-88d5-29c748112f0e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.170611 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b851bc35-b8d5-447c-88d5-29c748112f0e tempest-FlavorsAccessNegativeTestJSON-1909078931 tempest-FlavorsAccessNegativeTestJSON-1909078931-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6310 microversion: 2.1 time: 0.045411 Nov 02 12:36:29.172450 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 256/492] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:29 2022] GET /compute/v2.1/flavors/detail => generated 6310 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:29.177741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.178739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:29.187831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.188878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.189530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.190681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:29.191331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:29.191939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:29.197865 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1259a157-cfca-497c-ae8f-4f1dafa44224 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] HTTP exception thrown: Image not found. Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1259a157-cfca-497c-ae8f-4f1dafa44224 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Request method failure captured: Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/images/e09c39e8-890c-45cb-8aa1-927b6edc00d3 HTTP/1.1 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRKLzYrdMkeN7PoXOOq_-538I8NuN1--2IVIFgIIuG-xA4crmJsKW_cJwo7HYVklE2jgP3tqDWeslH6kcpYhgWmbZs7IIuuzDu1LW7_ffTyeav09C2Kz97WvU_t-92dO7__vAo3IGixRVOX6roON5GzVjGI1O-BsP_LuMGCLI9yHcQ Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:29.199843 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_70a0a123c2f74bfeb12dec018ad0d4d7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/70a0a123c2f74bfeb12dec018ad0d4d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/70a0a123c2f74bfeb12dec018ad0d4d7"}]}] Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 70a0a123c2f74bfeb12dec018ad0d4d7 Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-767735483 Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b81c259b7cab41409e166497eb1c45d1 Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-767735483-project Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e09c39e8-890c-45cb-8aa1-927b6edc00d3'} Nov 02 12:36:29.201088 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e09c39e8-890c-45cb-8aa1-927b6edc00d3 to delete Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:29.201786 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e09c39e8-890c-45cb-8aa1-927b6edc00d3 could not be found. Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:29.202767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1259a157-cfca-497c-ae8f-4f1dafa44224 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:29.204975 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1259a157-cfca-497c-ae8f-4f1dafa44224 tempest-ImagesDeleteNegativeTestJSON-767735483 tempest-ImagesDeleteNegativeTestJSON-767735483-project] 10.222.0.64 "DELETE /compute/v2.1/images/e09c39e8-890c-45cb-8aa1-927b6edc00d3" status: 404 len: 62 microversion: 2.1 time: 0.088467 Nov 02 12:36:29.208242 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 237/493] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:29 2022] DELETE /compute/v2.1/images/e09c39e8-890c-45cb-8aa1-927b6edc00d3 => generated 62 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:36:29.209575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3520f034-59b5-4e51-97e0-e66d6dd0f9a9 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] Calling method '.version_select at 0x7eff5c976700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:29.272670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:29.283177 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0c1a687f-a629-4c5b-a9f6-ffea0610e732 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1349 microversion: 2.1 time: 0.109382 Nov 02 12:36:29.284322 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 257/494] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:29 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:29.548012 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3520f034-59b5-4e51-97e0-e66d6dd0f9a9 tempest-ServersWithSpecificFlavorTestJSON-2042767784 tempest-ServersWithSpecificFlavorTestJSON-2042767784-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601079759" status: 202 len: 0 microversion: 2.1 time: 0.341270 Nov 02 12:36:29.549971 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 238/495] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:36:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601079759 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:30.159622 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.161178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.169047 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.181085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.185235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.186350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.187023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.192890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.316301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.317731 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.347643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.349222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.353782 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.354995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.355917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.356853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.747521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:30.771395 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27308104-6f43-4d2d-84d4-e5486828d6df tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.611344 Nov 02 12:36:30.772695 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 258/496] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:30 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:30.837697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8095f9ee-eb50-44ef-b083-e5d2e0cf5fa8 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.876173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:30.891793 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0d4d1ec6-d965-460f-9bd3-40cb0a99a966 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.580271 Nov 02 12:36:30.892379 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 239/497] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:30 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:31.040470 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8095f9ee-eb50-44ef-b083-e5d2e0cf5fa8 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1719706571" status: 202 len: 0 microversion: 2.1 time: 0.211417 Nov 02 12:36:31.045294 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 259/498] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:30 2022] DELETE /compute/v2.1/flavors/1719706571 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:31.050856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6a50a9c-9e8a-4521-9358-b409ef311a30 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.077230 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e6a50a9c-9e8a-4521-9358-b409ef311a30 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5895 microversion: 2.1 time: 0.030328 Nov 02 12:36:31.078257 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 260/499] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/flavors/detail => generated 5895 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:31.102154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9eb16af8-3ebf-4c7d-a3e1-a6f75e561aa1 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.262220 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9eb16af8-3ebf-4c7d-a3e1-a6f75e561aa1 tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/2059587386" status: 202 len: 0 microversion: 2.1 time: 0.165613 Nov 02 12:36:31.263549 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 261/500] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:31 2022] DELETE /compute/v2.1/flavors/2059587386 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:31.276260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-49b48c45-024d-4925-b0e9-26509cdf790a tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.340767 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-49b48c45-024d-4925-b0e9-26509cdf790a tempest-ServersWithSpecificFlavorTestJSON-1755887010 tempest-ServersWithSpecificFlavorTestJSON-1755887010-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.072374 Nov 02 12:36:31.341383 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 262/501] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:31.407061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd15d7bd-05c3-439c-914b-d80aece99113 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] Action: 'create', calling method: .version_select at 0x7eff5c84a8b0>, body: {"security_group": {"name": "tempest-securitygroup-1802676692", "description": "tempest-description-348707243"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:31.802311 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.803096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:31.811060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.811639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.812024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.813181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.814209 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.814663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.819395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:32.064964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.073828 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cf082ff2-855e-43c5-b629-9c9797ae845c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.275822 Nov 02 12:36:32.075022 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 263/502] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:32.088171 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:32.088819 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:32.101131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.102379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.102935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.104594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.105321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.105834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.501284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.509691 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6f70a3b7-95fd-4fc6-aba8-383cfa82cd54 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.428243 Nov 02 12:36:32.510319 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 264/503] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:32 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:32.515193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d9d819-116f-405e-b1e3-216d7fdc4818", "tag": "31495a98-f7a4-46d6-91fd-f475392a374c"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:32.528706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.529518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.534370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.543196 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] Creating event network-changed:31495a98-f7a4-46d6-91fd-f475392a374c for instance 98d9d819-116f-405e-b1e3-216d7fdc4818 on n-h2-857339-6 Nov 02 12:36:32.549963 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-90eb6583-cf6b-4465-aefd-fac8be740107 req-45db97f8-f436-46d2-91c5-cb88f12bb95f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038101 Nov 02 12:36:32.550583 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 265/504] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:32.945341 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fd15d7bd-05c3-439c-914b-d80aece99113 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.905967 Nov 02 12:36:32.945945 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 240/505] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:36:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:32.960414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cb68ac72-9620-40a4-b172-e32294bf3ceb tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] Action: 'create', calling method: .version_select at 0x7eff5c7afe50>, body: {"security_group": {"name": "tempest-securitygroup-724685369", "description": "tempest-description-1367488129"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:33.079972 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=22 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:33.106415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.106415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.118104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.118814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.122213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.124038 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.124574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.125029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.471467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.483814 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9d787831-0d2c-4e90-8208-950e832d8da6 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.386537 Nov 02 12:36:33.483814 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 241/506] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:33.535130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.535758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.542833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.543327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.543979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.545075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.545954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.546738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.984196 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cb68ac72-9620-40a4-b172-e32294bf3ceb tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.028004 Nov 02 12:36:33.994527 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 266/507] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:36:32 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:34.152099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:34.164348 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4c42aa4f-78c5-41cb-8624-cdb4498e54de tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.632885 Nov 02 12:36:34.165369 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 242/508] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:34.242040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:34.349011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9ff1708a-3cc2-4b01-94c4-0a1a7f69eb90 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] Action: 'create', calling method: .version_select at 0x7eff5c915d30>, body: {"security_group": {"name": "tempest-securitygroup-452145975", "description": "tempest-description-1165244005"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:34.514805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:34.515752 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:34.524011 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:34.524784 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:34.526578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:34.545171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:34.545171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:34.545171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.118320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:35.127597 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-615891d1-dd95-49bf-8102-b470864ffe52 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.626336 Nov 02 12:36:35.129741 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 243/509] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:34 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:35.192721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:35.195099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:35.207469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.210520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.210520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.210520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.210520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.211318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.069991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=58 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:36.069991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=19 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:36.238446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:36.247110 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-571c31a4-0572-4d86-9cd6-a4b9340c5fc3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 1.061280 Nov 02 12:36:36.250553 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 244/510] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:35 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:36.253402 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:36.254240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:36.261257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.262029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.262643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.263588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.264205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.264857 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.501478 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9ff1708a-3cc2-4b01-94c4-0a1a7f69eb90 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.495423 Nov 02 12:36:36.501478 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 267/511] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:36:33 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:36.531994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9f3ceedd-3a1a-4998-8cd2-f03b0c394f00 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] Action: 'create', calling method: .version_select at 0x7eff5c9159d0>, body: {"security_group": {"name": "tempest-securitygroup-436127493", "description": "tempest-description-957630052"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:36.585347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:36.597267 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1561685d-8f2b-4b14-bb0d-79a7fc72e35c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.345129 Nov 02 12:36:36.600133 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 245/512] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:36 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:37.049379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-369602547", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}], "block_device_mapping_v2": [{"uuid": "0a29da50-7261-45a5-8d25-80c522b4897a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:37.244393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] validate_networks() for [('6f31d9b0-b528-42bc-93ab-d8c292b878da', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:37.256204 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9f3ceedd-3a1a-4998-8cd2-f03b0c394f00 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.752466 Nov 02 12:36:37.264594 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 268/513] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:36:36 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:37.272032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-75c438c3-8368-4bed-8efa-c328f528b02d tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] Calling method '.version_select at 0x7eff5c8abc10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5c6ec4f-d721-422c-a698-b0e7b325cd52) Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:37.694224 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.703552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:37.704618 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:37.706061 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5c6ec4f-d721-422c-a698-b0e7b325cd52) Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Request method failure captured: Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 361 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKdqjqhiyGOblrTCk1CkW9W92_s9Beq0Ar670mJIcOFi9zFrUehPLepafMjxpAJe7KMAQQRMi5vicINrCewS1QEi1jaZnR_0RCHd5x29hpBrIkynmS2aGR8RN1piWpQ8ELFMWylFWANa_9w5cdg5uLXi7__opokh0LnVOrPxfl_L0 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.25 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:37.706996 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9774a0fd28c545c490450ef89610c63d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9774a0fd28c545c490450ef89610c63d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9774a0fd28c545c490450ef89610c63d"}]}] Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9774a0fd28c545c490450ef89610c63d Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668 Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ff76a6cbd0154558a0617fd081412831 Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2088693668-project Nov 02 12:36:37.708586 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-369602547", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "6f31d9b0-b528-42bc-93ab-d8c292b878da"}], "block_device_mapping_v2": [{"uuid": "0a29da50-7261-45a5-8d25-80c522b4897a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveAutoBlockMigrationV225Test-server-369602547', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '6f31d9b0-b528-42bc-93ab-d8c292b878da'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '0a29da50-7261-45a5-8d25-80c522b4897a'}]}}} Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:37.709198 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.710164 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:37.711234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:37.712324 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5c6ec4f-d721-422c-a698-b0e7b325cd52) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.721617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:37.723005 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-866c946c-53a1-47ca-9490-493869d77363 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.25 time: 0.653741 Nov 02 12:36:37.724044 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 246/514] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:36:37 2022] POST /compute/v2.1/servers => generated 214 bytes in 656 msecs (HTTP/1.1 500) 9 headers in 393 bytes (2 switches on core 0) Nov 02 12:36:37.724044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:37.724044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:37.729894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.736912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.736912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.736912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.736912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.737282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.081319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:38.112628 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8d3b4d9b-a9b6-41de-b747-fb589f30a136 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.411581 Nov 02 12:36:38.130972 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 247/515] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:37 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:38.130972 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.136772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:38.159068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.159635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.160108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.160859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.161459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.161802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.605881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:38.617883 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66c19120-7c64-497f-b9e1-79778f23baba tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.491267 Nov 02 12:36:38.635130 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 248/516] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:38.658871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-42e9d8d5-6f99-4b3a-b4f7-d938f7396be3 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] Calling method '.version_select at 0x7eff5c726ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.798569 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-42e9d8d5-6f99-4b3a-b4f7-d938f7396be3 tempest-LiveAutoBlockMigrationV225Test-2088693668 tempest-LiveAutoBlockMigrationV225Test-2088693668-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839367090" status: 204 len: 0 microversion: 2.25 time: 0.151720 Nov 02 12:36:38.806951 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 249/517] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Nov 2 12:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839367090 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:36:38.905669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d9d819-116f-405e-b1e3-216d7fdc4818", "name": "network-vif-plugged", "status": "completed", "tag": "31495a98-f7a4-46d6-91fd-f475392a374c"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:38.973497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.973497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.973497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.019657 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] Creating event network-vif-plugged:31495a98-f7a4-46d6-91fd-f475392a374c for instance 98d9d819-116f-405e-b1e3-216d7fdc4818 on n-h2-857339-6 Nov 02 12:36:39.035930 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-c23b8a66-2ff4-4a3a-a427-89c0b590fd91 req-b5336bd7-4799-46c1-be80-ce2db911a588 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139851 Nov 02 12:36:39.041519 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 250/518] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:39.159415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:39.162748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:39.184014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.184984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.185696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.187150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.187912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.188603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.435801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:39.449505 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8f332ef0-0eab-4902-8284-70f743b9da0c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.295625 Nov 02 12:36:39.461043 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 251/519] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:39 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:39.651128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:39.651128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:39.655581 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.656331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.657025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.657954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.658676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.659312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.278038 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:40.286865 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3e6dc857-fd0c-4d98-9164-785a09948d98 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.642722 Nov 02 12:36:40.296065 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 252/520] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:39 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:40.475029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:40.475901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:40.495136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.495136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.495136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.495136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:40.495529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:40.495529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:41.020135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:41.029685 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3f8a4519-6e2e-48af-aeea-e79582eddfb2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1379 microversion: 2.1 time: 0.559506 Nov 02 12:36:41.030366 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 253/521] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:40 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1379 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:41.332176 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76669043-8e91-4810-a617-f08c383e0dfe tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-843995211", "id": 279426217, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:41.546672 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-76669043-8e91-4810-a617-f08c383e0dfe tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.366859 Nov 02 12:36:41.548084 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 254/522] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:36:41 2022] POST /compute/v2.1/flavors => generated 467 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:41.571000 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:41.571839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:41.580775 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:41.581756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:41.582424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:41.583488 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:41.584218 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:41.584969 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.361223 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:42.379193 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7ba3a4a8-0742-4ba4-85d0-8a89c22da781 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.829564 Nov 02 12:36:42.380312 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 255/523] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:41 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:42.397543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e633f163-971e-436b-b80b-b926f9f9ad7b tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:42.527534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=15,nova_api:INSERT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:42.885125 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-75c438c3-8368-4bed-8efa-c328f528b02d tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] 10.222.0.64 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11740 microversion: 2.1 time: 5.617114 Nov 02 12:36:42.906122 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 269/524] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:36:37 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11740 bytes in 5632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:36:42.910786 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:42.914338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:42.926638 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e633f163-971e-436b-b80b-b926f9f9ad7b tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/279426217/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.544788 Nov 02 12:36:42.930053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.930929 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 256/525] 10.222.0.64 () {62 vars in 1262 bytes} [Wed Nov 2 12:36:42 2022] POST /compute/v2.1/flavors/279426217/os-extra_specs => generated 62 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:42.932723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.933348 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.935712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.937011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.941012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.945112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ad3d34f1-fd3f-4b36-9414-3d4312a955d7 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] Calling method '.version_select at 0x7eff5c726e50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.646283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:43.661249 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-15767d7c-b0bb-4906-bccb-ad8e570fb835 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1529 microversion: 2.1 time: 0.759446 Nov 02 12:36:43.664526 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 270/526] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:42 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1529 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:43.675003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e46a0af6-1d55-4283-8071-4b6f97a5e61b tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.858127 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e46a0af6-1d55-4283-8071-4b6f97a5e61b tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/279426217" status: 202 len: 0 microversion: 2.86 time: 0.191937 Nov 02 12:36:43.859349 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 271/527] 10.222.0.64 () {60 vars in 1199 bytes} [Wed Nov 2 12:36:43 2022] DELETE /compute/v2.1/flavors/279426217 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:43.872327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.873495 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:43.890948 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.894198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.894198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:43.894198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.896003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.897884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.005876 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ad3d34f1-fd3f-4b36-9414-3d4312a955d7 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 1.069989 Nov 02 12:36:44.009168 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 257/528] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:36:42 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.012196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.013597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:44.030555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.049432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.049432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.053385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.055603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.056902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.517210 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.526507 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-84d1c2aa-b73f-4d77-bda1-731e9ca2f8d3 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1529 microversion: 2.1 time: 0.518888 Nov 02 12:36:44.541391 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 258/529] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1529 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.556754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e83d1e8d-2c8d-4b3d-aaaf-06fe8d44b544 tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.622208 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e83d1e8d-2c8d-4b3d-aaaf-06fe8d44b544 tempest-FlavorMetadataValidation-1160533611 tempest-FlavorMetadataValidation-1160533611-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 6305 microversion: 2.86 time: 0.062041 Nov 02 12:36:44.622208 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 259/530] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/flavors/detail => generated 6305 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:44.622208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b88a579-04b8-4706-b4de-29886488bb68 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] Calling method '.version_select at 0x7eff5c78d670>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.645856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:44.658956 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aa94aa9a-8509-44f8-a281-4027a9678171 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1470 microversion: 2.1 time: 0.797771 Nov 02 12:36:44.663541 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 272/531] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:43 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1470 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.674389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cf1dbc14-cb01-4dc3-a3f4-6ff4d897918b tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.826214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cf1dbc14-cb01-4dc3-a3f4-6ff4d897918b tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/0a129016-013e-45c6-922e-8a26e195bed7" status: 202 len: 0 microversion: 2.1 time: 0.161108 Nov 02 12:36:44.827466 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 273/532] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:44 2022] DELETE /compute/v2.1/flavors/0a129016-013e-45c6-922e-8a26e195bed7 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:44.838519 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4c6a7df3-a15c-427d-b9e4-29ab831af3e8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.876687 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4c6a7df3-a15c-427d-b9e4-29ab831af3e8 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043909 Nov 02 12:36:44.892425 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 274/533] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:44.904811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:44.907778 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:44.920237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.920768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.921205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.922000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.922363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.922781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c020b596-0bbe-456d-8d9c-cb6fdaef7936) Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:36:45.027137 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:45.028425 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:45.029735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c020b596-0bbe-456d-8d9c-cb6fdaef7936) Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.030844 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:45.032239 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818/action HTTP/1.1 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 32 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:36:45.037796 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: {"resize": {"flavorRef": "451"}} Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:45.043051 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '98d9d819-116f-405e-b1e3-216d7fdc4818', 'body': {'resize': {'flavorRef': '451'}}} Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:45.043821 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:45.044918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:45.045895 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c020b596-0bbe-456d-8d9c-cb6fdaef7936) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:45.047588 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:45.048693 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:45.049720 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-57747912-0e46-4c93-aeaa-77cb0b49d22e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818/action" status: 500 len: 214 microversion: 2.1 time: 0.140425 Nov 02 12:36:45.049720 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 275/534] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:36:44 2022] POST /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818/action => generated 214 bytes in 142 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:36:45.056791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d7be0d2-45d8-4c1d-845f-506ed2907569 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:45.068176 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-8d7be0d2-45d8-4c1d-845f-506ed2907569 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] HTTP exception thrown: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d7be0d2-45d8-4c1d-845f-506ed2907569 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Request method failure captured: Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/flavors/0a129016-013e-45c6-922e-8a26e195bed7 HTTP/1.1 Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQLx3IDTZGxhKhLI9_nRs10rIjiqd_Qi3cmGMashjMAvq5IPa3RJVmTSj0OUGJWp7NuUar8RJkxsfLoRqdMrY3fQHb0Xk4FqxPoUjRQ8yNKtt_kjJ9aUpkTrdeqjfjQ_VQ_aPgzd-7B2JlyVQoP8_pU8jYFEuwSKnCg4gHiCeUe6Uc Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:36:45.070526 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2046c3ec9ae24830ac6194791d986f0d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}] Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-293810145 Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 1f30f86e527d484fa6f592b13e4c081d Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: exception: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. Nov 02 12:36:45.072591 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '0a129016-013e-45c6-922e-8a26e195bed7'} Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi flavor.destroy() Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.073431 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. Nov 02 12:36:45.074810 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:36:45.078315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d7be0d2-45d8-4c1d-845f-506ed2907569 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Returning 404 to user: Flavor 0a129016-013e-45c6-922e-8a26e195bed7 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:45.079404 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d7be0d2-45d8-4c1d-845f-506ed2907569 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/0a129016-013e-45c6-922e-8a26e195bed7" status: 404 len: 109 microversion: 2.1 time: 0.028851 Nov 02 12:36:45.081914 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 276/535] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:45 2022] DELETE /compute/v2.1/flavors/0a129016-013e-45c6-922e-8a26e195bed7 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:45.236915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2032482908", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:45.327207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:45.485858 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b88a579-04b8-4706-b4de-29886488bb68 tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/3625d89c-5a02-45f2-b3ac-f31b81424d65" status: 202 len: 0 microversion: 2.1 time: 0.869208 Nov 02 12:36:45.495293 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 260/536] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:36:44 2022] DELETE /compute/v2.1/os-security-groups/3625d89c-5a02-45f2-b3ac-f31b81424d65 => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:45.542667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6778c320-375e-4392-b7ce-95247a0a9fbb tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] Calling method '.version_select at 0x7eff5c78de50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.620967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:46.622074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:46.622570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:46.623278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:46.623420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:46.648714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.649604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.656873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.656873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.656873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.656873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.705414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:46.715669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Getting quotas for user 976993a09f2342c68dab07da6a7dd236 and project 9929679b00cb4db39002b1ae432a2539. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:46.773387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:36:46.776896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:36:46.970968 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9cb449af-4b86-4cee-80c9-2cdd022935f0 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.734848 Nov 02 12:36:46.974820 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 277/537] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:36:47.011396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.015045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:47.047367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.047970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.048429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.052270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.052740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.059855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.084367 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6778c320-375e-4392-b7ce-95247a0a9fbb tempest-SecurityGroupsTestAdminJSON-2026670291 tempest-SecurityGroupsTestAdminJSON-2026670291-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/57d2d6fd-d211-4f33-8fcb-0c4716b82661" status: 202 len: 0 microversion: 2.1 time: 1.587036 Nov 02 12:36:47.085313 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 261/538] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:36:45 2022] DELETE /compute/v2.1/os-security-groups/57d2d6fd-d211-4f33-8fcb-0c4716b82661 => generated 0 bytes in 1589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:47.095858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4753368c-ed37-47ce-8947-3cc8df030180 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.096868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4753368c-ed37-47ce-8947-3cc8df030180 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:47.386593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4753368c-ed37-47ce-8947-3cc8df030180 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:47.409382 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4753368c-ed37-47ce-8947-3cc8df030180 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1213 microversion: 2.1 time: 0.318695 Nov 02 12:36:47.416456 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 262/539] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1213 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:47.432432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2db2e99e-19f1-44d2-b8b2-bb46780f3126 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] Calling method '.version_select at 0x7eff5c7268b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.906157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:47.919988 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0ba01efd-4432-44a0-a8f0-b663eb11fccd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 0.944528 Nov 02 12:36:47.936583 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 278/540] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:46 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.250854 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2db2e99e-19f1-44d2-b8b2-bb46780f3126 tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/becfb30b-ca13-49b8-892d-f47606b41460" status: 202 len: 0 microversion: 2.1 time: 0.832256 Nov 02 12:36:48.254993 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 263/541] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:36:47 2022] DELETE /compute/v2.1/os-security-groups/becfb30b-ca13-49b8-892d-f47606b41460 => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:48.259947 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cb392310-5b5e-459e-8540-af5c33f44b7f tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] Calling method '.version_select at 0x7eff5c8c6ee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.443242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-afe610b8-e24b-4367-98ac-21d1292ec16c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.444169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-afe610b8-e24b-4367-98ac-21d1292ec16c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:48.613369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-afe610b8-e24b-4367-98ac-21d1292ec16c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:48.636904 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-afe610b8-e24b-4367-98ac-21d1292ec16c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1213 microversion: 2.1 time: 0.198976 Nov 02 12:36:48.650768 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 264/542] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1213 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.950992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.951941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:48.975441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.976094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.976690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.977717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.978474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.979173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.203176 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cb392310-5b5e-459e-8540-af5c33f44b7f tempest-SecurityGroupsTestAdminJSON-2029029790 tempest-SecurityGroupsTestAdminJSON-2029029790-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/8c59ec00-f974-49e4-b6fe-47774f873b3e" status: 202 len: 0 microversion: 2.1 time: 0.945315 Nov 02 12:36:49.208347 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 279/543] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:36:48 2022] DELETE /compute/v2.1/os-security-groups/8c59ec00-f974-49e4-b6fe-47774f873b3e => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:49.434338 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:49.439720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:49.447557 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-92e1812d-e241-46a3-b5bd-fa308951ccce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 0.502150 Nov 02 12:36:49.449165 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 265/544] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:49.672078 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:49.675547 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:49.685108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.685342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.686063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.686938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.687615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.688255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.826393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:49.840275 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b0836f61-695e-4c7e-9f8d-dba6cb01c167 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1209 microversion: 2.1 time: 0.171909 Nov 02 12:36:49.841672 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 280/545] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:49 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1209 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:50.530518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:50.542179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:50.564948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.565960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.566844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:50.568149 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.569644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.570370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:50.877544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:50.878937 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:50.890855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.891636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.892947 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:50.894033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.894677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.895290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:51.119278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:51.150584 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-204f1871-fbc7-4d7e-a5a9-0b73d24695bb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 0.643765 Nov 02 12:36:51.154458 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 266/546] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:50 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:51.563045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:51.572288 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eff6433d-6d7d-40ce-837b-66ab64ffde2c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1265 microversion: 2.1 time: 0.704542 Nov 02 12:36:51.599842 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 281/547] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:50 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1265 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:52.086386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:52.104824 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.105909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.107323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.131840 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] Creating event network-vif-unplugged:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:36:52.149067 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-fde4d18d-d65a-4c29-92d6-06faa06292a4 req-794a24b4-4147-4bce-99f9-e8d218494320 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065844 Nov 02 12:36:52.150571 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 282/548] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:52.193913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:52.194841 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:52.206581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.207729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.209466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.210589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.213197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.213892 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.634767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:52.654200 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dd9fb5a6-6a9c-472e-a922-b9e3d778a38c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 0.467527 Nov 02 12:36:52.654810 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 283/549] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:52 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:52.667450 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:52.674314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:52.704099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.704631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.708727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.713713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.716927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.719877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:53.109189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-380490154", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "53a9baff-a6fc-47f8-9256-abe44ef69f1e"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:53.256354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] validate_networks() for [('53a9baff-a6fc-47f8-9256-abe44ef69f1e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:53.729646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:53.747641 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-29134eac-1817-4fcd-b5ce-78c30e416d91 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1271 microversion: 2.1 time: 1.091309 Nov 02 12:36:53.748297 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 284/550] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:52 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1271 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:53.758207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:53.759076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:53.782617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.782617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.782617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:53.782617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.783402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.783402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.797123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:54.823012 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6edc9ce8-cd3f-4a70-99fc-38b356bdbe63 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 1.070713 Nov 02 12:36:54.839360 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 285/551] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:53 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:54.869565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:54.877866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:54.900136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.902515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.902978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.903733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.906410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.909591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bc9fa0a7-1521-4d04-99de-ca4b57babb18) Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:54.972159 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.973750 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:54.974936 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:54.976203 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:54.977289 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bc9fa0a7-1521-4d04-99de-ca4b57babb18) Nov 02 12:36:54.977289 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.977289 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:54.977289 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Request method failure captured: Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 207 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRj1PuySKTl5cvl7mf-GQTQKRD02qJF2PfES-YyAF8a-fdgWmz_DrE_jwVANqdTQbSndZdfSJ73HQU4Emst94qTbD0K1SxsyycbR-IctBnAZ4S0dS6kwTw7ltNFposVl483ptDEyoh6PGKVZtfbKIggoTnWW-4xhLMuCX5xpYcV-CY Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:54.981825 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d20ecfbbcbcd4953aed36bc1c7e4c054", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}] Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b6215b447217431dbf79ad5b037d1b59 Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:54.983387 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-380490154", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "53a9baff-a6fc-47f8-9256-abe44ef69f1e"}]}} Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ImagesNegativeTestJSON-server-380490154', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '53a9baff-a6fc-47f8-9256-abe44ef69f1e'}]}}} Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:36:54.984193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.985406 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:36:54.986631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:36:54.987807 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bc9fa0a7-1521-4d04-99de-ca4b57babb18) Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:54.998250 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0a0cc405-df1c-4aa0-9aca-2e655414370b tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.187906 Nov 02 12:36:54.999781 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 267/552] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 3190 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:36:55.016882 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-708482799", "metadata": {"image_type": "test"}}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:55.020425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Failed to fetch instance by id tempest-invalid-1533270746 {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:36:55.024570 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] HTTP exception thrown: Instance tempest-invalid-1533270746 could not be found. Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Request method failure captured: Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/tempest-invalid-1533270746/action HTTP/1.1 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 111 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRj1PuySKTl5cvl7mf-GQTQKRD02qJF2PfES-YyAF8a-fdgWmz_DrE_jwVANqdTQbSndZdfSJ73HQU4Emst94qTbD0K1SxsyycbR-IctBnAZ4S0dS6kwTw7ltNFposVl483ptDEyoh6PGKVZtfbKIggoTnWW-4xhLMuCX5xpYcV-CY Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:55.036713 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d20ecfbbcbcd4953aed36bc1c7e4c054", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}] Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b6215b447217431dbf79ad5b037d1b59 Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-708482799", "metadata": {"image_type": "test"}}} Nov 02 12:36:55.045227 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance tempest-invalid-1533270746 could not be found. Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'tempest-invalid-1533270746', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-708482799', 'metadata': {'image_type': 'test'}}}} Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1533270746 could not be found. Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:55.046210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1533270746 could not be found. Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1533270746 could not be found. Nov 02 12:36:55.047622 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.049093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Returning 404 to user: Instance tempest-invalid-1533270746 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:55.049093 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cab77710-9211-46e1-a21a-99332eefc05e tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] 10.222.0.64 "POST /compute/v2.1/servers/tempest-invalid-1533270746/action" status: 404 len: 101 microversion: 2.1 time: 0.029625 Nov 02 12:36:55.050430 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 268/553] 10.222.0.64 () {60 vars in 1249 bytes} [Wed Nov 2 12:36:55 2022] POST /compute/v2.1/servers/tempest-invalid-1533270746/action => generated 101 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:36:55.080975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1437956425"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:55.083353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:36:55.083977 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Request method failure captured: Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 57 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRj1PuySKTl5cvl7mf-GQTQKRD02qJF2PfES-YyAF8a-fdgWmz_DrE_jwVANqdTQbSndZdfSJ73HQU4Emst94qTbD0K1SxsyycbR-IctBnAZ4S0dS6kwTw7ltNFposVl483ptDEyoh6PGKVZtfbKIggoTnWW-4xhLMuCX5xpYcV-CY Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:55.089588 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d20ecfbbcbcd4953aed36bc1c7e4c054", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}] Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b6215b447217431dbf79ad5b037d1b59 Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: {"createImage": {"name": "tempest-test-snap-1437956425"}} Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:55.090911 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1437956425'}}} Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.091774 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.093132 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.096406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:55.101666 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a161be91-690a-48a3-b48a-2ef04d2f58fc tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] 10.222.0.64 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.039163 Nov 02 12:36:55.104453 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 269/554] 10.222.0.64 () {60 vars in 1275 bytes} [Wed Nov 2 12:36:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:55.130683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-270012674"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:55.137240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:36:55.137928 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Request method failure captured: Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 56 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRj1PuySKTl5cvl7mf-GQTQKRD02qJF2PfES-YyAF8a-fdgWmz_DrE_jwVANqdTQbSndZdfSJ73HQU4Emst94qTbD0K1SxsyycbR-IctBnAZ4S0dS6kwTw7ltNFposVl483ptDEyoh6PGKVZtfbKIggoTnWW-4xhLMuCX5xpYcV-CY Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:36:55.140061 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d20ecfbbcbcd4953aed36bc1c7e4c054", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d20ecfbbcbcd4953aed36bc1c7e4c054"}]}] Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d20ecfbbcbcd4953aed36bc1c7e4c054 Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1053449876 Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b6215b447217431dbf79ad5b037d1b59 Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesNegativeTestJSON-1053449876-project Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: {"createImage": {"name": "tempest-test-snap-270012674"}} Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:36:55.141655 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-270012674'}}} Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.142862 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Nov 02 12:36:55.144558 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:36:55.156812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:55.158133 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fd76bc46-1f74-42d6-b082-b7c8a60ec4b7 tempest-ImagesNegativeTestJSON-1053449876 tempest-ImagesNegativeTestJSON-1053449876-project] 10.222.0.64 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.048128 Nov 02 12:36:55.166914 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 270/555] 10.222.0.64 () {60 vars in 1281 bytes} [Wed Nov 2 12:36:55 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:55.445060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:55.458782 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27d29253-66d8-4f4a-8e37-cb4f9f95790d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.617519 Nov 02 12:36:55.459401 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 286/556] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:54 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:55.853572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:55.854477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:55.864859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:55.869824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:55.870657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:55.871571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:55.872204 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:55.872976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.363360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:56.383302 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-42fe396a-d1a0-4a89-acac-209cba32e6cd tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 0.535583 Nov 02 12:36:56.384122 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 271/557] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:55 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:56.485973 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:56.486896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:56.496862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.510333 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.515698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.518515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.522083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.522980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.673043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:56.766966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=6 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:57.407090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:57.408315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:57.415682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.416284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.416792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.417609 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.418080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.423781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.457794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:57.467111 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5fccbe7b-2d0b-4d7a-8fe3-d6248851403b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.986352 Nov 02 12:36:57.471111 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 287/558] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:56 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:57.936115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b8f19156-4fcd-4367-b777-630dda46e495 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-330335389", "ram": 512, "vcpus": 1, "disk": 10, "id": 1294767402, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:58.037595 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b8f19156-4fcd-4367-b777-630dda46e495 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.550637 Nov 02 12:36:58.038853 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 288/559] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:57 2022] POST /compute/v2.1/flavors => generated 415 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:58.056088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-plugged", "status": "completed", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:58.093044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:58.093617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:58.108949 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.162478 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] Creating event network-vif-plugged:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:36:58.175951 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-7d492928-d439-403a-a84e-ca037439455d req-e11e79a0-d559-4d37-bcbb-bec6c6f67456 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133190 Nov 02 12:36:58.177600 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 289/560] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:58.191922 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0433bace-2910-4341-a49c-ee1d2404e212 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:58.415969 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0433bace-2910-4341-a49c-ee1d2404e212 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.234488 Nov 02 12:36:58.416733 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 290/561] 10.222.0.64 () {60 vars in 1224 bytes} [Wed Nov 2 12:36:58 2022] POST /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:58.515761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:58.524338 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0bc3b12a-2709-4c93-ad83-8db9aed7483f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 1.120648 Nov 02 12:36:58.525527 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 272/562] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:57 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:58.536899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:58.537520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:58.554087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:58.561469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:58.561469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.561469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:58.561469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:58.561842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.637347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.023290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:59.036294 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-35059236-e941-4eaf-9ba8-575ee398b9eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.509488 Nov 02 12:36:59.051431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-da54c3e2-5d34-43a0-89af-577c06ffcd23 tempest-FlavorsExtraSpecsTestJSON-186995826 tempest-FlavorsExtraSpecsTestJSON-186995826-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.055943 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 273/563] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:58 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:59.075839 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-da54c3e2-5d34-43a0-89af-577c06ffcd23 tempest-FlavorsExtraSpecsTestJSON-186995826 tempest-FlavorsExtraSpecsTestJSON-186995826-project] 10.222.0.64 "GET /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.651055 Nov 02 12:36:59.079828 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 291/564] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:36:58 2022] GET /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.091026 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f20c547a-fdb1-4009-ad9c-93e06d444471 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:59.146640 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f20c547a-fdb1-4009-ad9c-93e06d444471 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059857 Nov 02 12:36:59.147612 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 274/565] 10.222.0.64 () {60 vars in 1224 bytes} [Wed Nov 2 12:36:59 2022] POST /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.157812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-21358ca3-5509-47a9-9bca-e6ad4e1a1894 tempest-FlavorsExtraSpecsTestJSON-186995826 tempest-FlavorsExtraSpecsTestJSON-186995826-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.172707 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-21358ca3-5509-47a9-9bca-e6ad4e1a1894 tempest-FlavorsExtraSpecsTestJSON-186995826 tempest-FlavorsExtraSpecsTestJSON-186995826-project] 10.222.0.64 "GET /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018789 Nov 02 12:36:59.173610 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 292/566] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes => generated 22 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.183880 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5d6e74c6-b18e-4a11-885b-f437514b408e tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:59.219084 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5657e408-c6af-4b09-ad7a-f20fcc1aeba8", "tag": "1b059224-13f3-4473-b9fb-179846b9a3cd"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:59.225508 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5d6e74c6-b18e-4a11-885b-f437514b408e tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.045405 Nov 02 12:36:59.229674 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 275/567] 10.222.0.64 () {60 vars in 1224 bytes} [Wed Nov 2 12:36:59 2022] POST /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.238308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.239363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.239993 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.247913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-868df544-ffd2-4047-a5c7-d27a88b598e6 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.256888 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] Creating event network-changed:1b059224-13f3-4473-b9fb-179846b9a3cd for instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 on n-h2-857339-6 Nov 02 12:36:59.263727 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-ed0fe81b-a1fd-440c-a182-d34851910327 req-0ea2a1b1-5c6d-4248-a843-40519a00bee6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048784 Nov 02 12:36:59.264984 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 293/568] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:59.268189 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-868df544-ffd2-4047-a5c7-d27a88b598e6 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032330 Nov 02 12:36:59.269418 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 276/569] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.295221 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bc80fbc0-4e64-4454-8c36-c0bbe1c3815d tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:59.481400 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bc80fbc0-4e64-4454-8c36-c0bbe1c3815d tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "PUT /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.204709 Nov 02 12:36:59.484097 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 294/570] 10.222.0.64 () {60 vars in 1265 bytes} [Wed Nov 2 12:36:59 2022] PUT /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes => generated 22 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.490407 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:SAVEPOINT=6,nova_api:RELEASE=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.495102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1a7956bb-d6e6-4879-8f9b-b5de5fd1d5bf tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.511362 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1a7956bb-d6e6-4879-8f9b-b5de5fd1d5bf tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014234 Nov 02 12:36:59.513560 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 277/571] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/flavors/1294767402/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:59.535928 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c4c3a1f5-1fd0-414a-82dc-0e6a46b83860 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.553027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.553634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:59.562643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=6,nova_api:INSERT=6,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:59.570247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.570744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.574555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.577942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.578597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.580164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.671930 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c4c3a1f5-1fd0-414a-82dc-0e6a46b83860 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.144996 Nov 02 12:36:59.673087 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 295/572] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:36:59 2022] DELETE /compute/v2.1/flavors/1294767402/os-extra_specs/hw:numa_nodes => generated 0 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:36:59.694160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-50d40855-1644-4772-a913-8ec88659dcc1 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.850380 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-50d40855-1644-4772-a913-8ec88659dcc1 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1294767402/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.173129 Nov 02 12:36:59.854644 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 296/573] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:36:59 2022] DELETE /compute/v2.1/flavors/1294767402/os-extra_specs/hw:cpu_policy => generated 0 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 12:36:59.859935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-790f1a9a-5114-4742-b9be-329ea2770674 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.878680 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-790f1a9a-5114-4742-b9be-329ea2770674 tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/1294767402/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022643 Nov 02 12:36:59.883029 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 297/574] 10.222.0.64 () {58 vars in 1203 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/flavors/1294767402/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:36:59.894546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7bcb74e1-37a6-4522-9aac-87d07ffb922b tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:00.024680 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7bcb74e1-37a6-4522-9aac-87d07ffb922b tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1294767402" status: 202 len: 0 microversion: 2.1 time: 0.135874 Nov 02 12:37:00.026325 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 298/575] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:36:59 2022] DELETE /compute/v2.1/flavors/1294767402 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:37:00.038870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1cbfc285-ca56-4a1b-94a5-7e1e0f8288fa tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:00.069746 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1cbfc285-ca56-4a1b-94a5-7e1e0f8288fa tempest-FlavorsExtraSpecsTestJSON-691923295 tempest-FlavorsExtraSpecsTestJSON-691923295-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038291 Nov 02 12:37:00.077073 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 299/576] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:00.095184 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:00.096099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:00.103470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.103965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.104401 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:00.105204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.105661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.106084 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:00.567796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:00.584514 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9d84a70e-1402-43a8-8955-a9f0cc7e89fb tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1476 microversion: 2.1 time: 1.030109 Nov 02 12:37:00.584514 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 278/577] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1476 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:01.036178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.067849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f642a5b0-3151-4810-af86-47d94a8cdbff tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.986850 Nov 02 12:37:01.067849 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 300/578] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:00 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:01.108413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-112376456", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:01.210884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:01.345687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f48b7bfe-3cfa-4b87-9ea0-3cc9aa0c623c tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Calling method '.version_select at 0x7eff5c790310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.345687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f48b7bfe-3cfa-4b87-9ea0-3cc9aa0c623c tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '5360364df7cc46219d391aea722ed616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee661ddce84e47739e0959409b2b9437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f48b7bfe-3cfa-4b87-9ea0-3cc9aa0c623c tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Request method failure captured: Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRqkrnf238MxNfMfovGfLCXz_0y_oXnkVSWHyfRFO2koQ0S7uriXDzpl0zXeZQL5ybbZM3ofNF_l3xYMu16rLuNoKJcJKBwtMXmRMy1Cud6bAQN14AGbBGAYHn0iKFQoONYtIhrfSUw7J-rNQVf3VX6xNOLYmdR912LQWhqTz7oDjM Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:01.346758 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee661ddce84e47739e0959409b2b9437", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}] Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5360364df7cc46219d391aea722ed616 Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: action_args: {} Nov 02 12:37:01.348024 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._detail(req) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:01.349568 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Nov 02 12:37:01.351418 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.353486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f48b7bfe-3cfa-4b87-9ea0-3cc9aa0c623c tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:01.353486 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f48b7bfe-3cfa-4b87-9ea0-3cc9aa0c623c tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.279627 Nov 02 12:37:01.353486 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 301/579] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:01.365610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7a9ec13-e2cd-4ec3-b5c2-0c2b5ec5e65d tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Calling method '.version_select at 0x7eff5c8ab5e0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.371957 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a7a9ec13-e2cd-4ec3-b5c2-0c2b5ec5e65d tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '5360364df7cc46219d391aea722ed616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee661ddce84e47739e0959409b2b9437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7a9ec13-e2cd-4ec3-b5c2-0c2b5ec5e65d tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Request method failure captured: Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRqkrnf238MxNfMfovGfLCXz_0y_oXnkVSWHyfRFO2koQ0S7uriXDzpl0zXeZQL5ybbZM3ofNF_l3xYMu16rLuNoKJcJKBwtMXmRMy1Cud6bAQN14AGbBGAYHn0iKFQoONYtIhrfSUw7J-rNQVf3VX6xNOLYmdR912LQWhqTz7oDjM Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:01.382462 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee661ddce84e47739e0959409b2b9437", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}] Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5360364df7cc46219d391aea722ed616 Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: action_args: {} Nov 02 12:37:01.384777 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:01.393399 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Nov 02 12:37:01.395068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.396415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7a9ec13-e2cd-4ec3-b5c2-0c2b5ec5e65d tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:01.396415 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a7a9ec13-e2cd-4ec3-b5c2-0c2b5ec5e65d tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.022856 Nov 02 12:37:01.396415 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 302/580] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:01.397766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bd4db055-f37f-480c-88d8-14be72ac8e14 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Calling method '.version_select at 0x7eff5c8ab790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.400149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bd4db055-f37f-480c-88d8-14be72ac8e14 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '5360364df7cc46219d391aea722ed616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee661ddce84e47739e0959409b2b9437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bd4db055-f37f-480c-88d8-14be72ac8e14 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Request method failure captured: Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRqkrnf238MxNfMfovGfLCXz_0y_oXnkVSWHyfRFO2koQ0S7uriXDzpl0zXeZQL5ybbZM3ofNF_l3xYMu16rLuNoKJcJKBwtMXmRMy1Cud6bAQN14AGbBGAYHn0iKFQoONYtIhrfSUw7J-rNQVf3VX6xNOLYmdR912LQWhqTz7oDjM Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:01.402004 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee661ddce84e47739e0959409b2b9437", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}] Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5360364df7cc46219d391aea722ed616 Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: action_args: {} Nov 02 12:37:01.403643 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:01.411045 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Nov 02 12:37:01.420175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.421843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bd4db055-f37f-480c-88d8-14be72ac8e14 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:01.421843 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bd4db055-f37f-480c-88d8-14be72ac8e14 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.011262 Nov 02 12:37:01.421843 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 303/581] 10.222.0.64 () {58 vars in 1179 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:37:01.487405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Calling method '.version_select at 0x7eff5c7af4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.489325 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.492741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.492741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.505530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.506016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.506453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.519574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.520148 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.520798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.531573 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c2cf669-6d5c-410a-b5bc-885398056606 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.119845 Nov 02 12:37:01.533034 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 304/582] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:01.549917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08f223f1-c6e9-48f9-a677-722ca019e11e tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Calling method '.version_select at 0x7eff5c8abee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.552004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-08f223f1-c6e9-48f9-a677-722ca019e11e tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '5360364df7cc46219d391aea722ed616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee661ddce84e47739e0959409b2b9437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08f223f1-c6e9-48f9-a677-722ca019e11e tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Request method failure captured: Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRqkrnf238MxNfMfovGfLCXz_0y_oXnkVSWHyfRFO2koQ0S7uriXDzpl0zXeZQL5ybbZM3ofNF_l3xYMu16rLuNoKJcJKBwtMXmRMy1Cud6bAQN14AGbBGAYHn0iKFQoONYtIhrfSUw7J-rNQVf3VX6xNOLYmdR912LQWhqTz7oDjM Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:01.553792 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee661ddce84e47739e0959409b2b9437", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}] Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5360364df7cc46219d391aea722ed616 Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1'} Nov 02 12:37:01.555457 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:01.556423 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Nov 02 12:37:01.559727 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.560968 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08f223f1-c6e9-48f9-a677-722ca019e11e tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:01.560968 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-08f223f1-c6e9-48f9-a677-722ca019e11e tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011668 Nov 02 12:37:01.560968 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 305/583] 10.222.0.64 () {58 vars in 1173 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:01.568981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-266a719f-4740-40c5-a0dd-32592509bbcd tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Calling method '.version_select at 0x7eff5c790310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.571578 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-266a719f-4740-40c5-a0dd-32592509bbcd tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] HTTP exception thrown: Hypervisor with ID '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' could not be found. Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-266a719f-4740-40c5-a0dd-32592509bbcd tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Request method failure captured: Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/18a82f46-9112-4614-b9fb-6ecbe3f71eaf/uptime HTTP/1.1 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRsCiHMM0rLKTdfalWOBrjxsfhv8bL1eFx7ywUrCSTHjm1r9qQiAOMJRFEh5kf_pNf3PcN_wff31emXBfyWeF_bEtmjuW312sGb72MXHPOdA1F952E7Lh85rEPyzoprtzTQSjuKIV5PycIjMWBQ6vhxut_eGJwYfLdJE8LiEZrRIZ8 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a9211ecdb00a45a8abb6d6511f3c1fd7 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:37:01.582248 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a9211ecdb00a45a8abb6d6511f3c1fd7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}] Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a9211ecdb00a45a8abb6d6511f3c1fd7 Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a71ed8d0a2b84b62970be869e4ded2cc Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: exception: Hypervisor with ID '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' could not be found. Nov 02 12:37:01.583753 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '18a82f46-9112-4614-b9fb-6ecbe3f71eaf'} Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 12:37:01.584680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' could not be found. Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:01.587334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' could not be found. Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-266a719f-4740-40c5-a0dd-32592509bbcd tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Returning 404 to user: Hypervisor with ID '18a82f46-9112-4614-b9fb-6ecbe3f71eaf' could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-266a719f-4740-40c5-a0dd-32592509bbcd tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/18a82f46-9112-4614-b9fb-6ecbe3f71eaf/uptime" status: 404 len: 123 microversion: 2.1 time: 0.020314 Nov 02 12:37:01.589912 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 306/584] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors/18a82f46-9112-4614-b9fb-6ecbe3f71eaf/uptime => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:37:01.598645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Calling method '.version_select at 0x7eff5c915dc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.601879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.602949 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.604578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.622134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.622743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.623667 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.627969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:01.655843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.655843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.655843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.658417 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6dd7c07d-6f60-4a42-b1f7-86cff4c84685 tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.063741 Nov 02 12:37:01.659458 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 307/585] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:01.665513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:01.666661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:01.674114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.675218 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.675767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:01.676928 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:01.677542 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:01.678420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.424274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:02.425922 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:02.427410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:02.428063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:02.428742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:02.449598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.457669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.457669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.457669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.457669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.458071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.478975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Getting quotas for project b94df274ea1b4a2387fa8a717cb3ca3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:02.485133 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Getting quotas for user bbede44ae7194b4e97bc67e0dc8207b3 and project b94df274ea1b4a2387fa8a717cb3ca3b. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:02.522076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:02.531917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:02.669388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:02.683233 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a0ebdcb4-95e1-4c06-adce-e4c5bacbe0ff tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1462 microversion: 2.1 time: 1.021934 Nov 02 12:37:02.685549 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 308/586] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:01 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1462 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:02.702995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a669f8e2-0acc-4bac-b000-a0d97aac7183 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Calling method '.version_select at 0x7eff5c8abd30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:02.708806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a669f8e2-0acc-4bac-b000-a0d97aac7183 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '5360364df7cc46219d391aea722ed616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee661ddce84e47739e0959409b2b9437', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a669f8e2-0acc-4bac-b000-a0d97aac7183 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Request method failure captured: Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRqkrnf238MxNfMfovGfLCXz_0y_oXnkVSWHyfRFO2koQ0S7uriXDzpl0zXeZQL5ybbZM3ofNF_l3xYMu16rLuNoKJcJKBwtMXmRMy1Cud6bAQN14AGbBGAYHn0iKFQoONYtIhrfSUw7J-rNQVf3VX6xNOLYmdR912LQWhqTz7oDjM Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:02.710690 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ee661ddce84e47739e0959409b2b9437", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ee661ddce84e47739e0959409b2b9437"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ee661ddce84e47739e0959409b2b9437"}]}] Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ee661ddce84e47739e0959409b2b9437 Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515 Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5360364df7cc46219d391aea722ed616 Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2047678515-project Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1'} Nov 02 12:37:02.712066 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:02.712885 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Nov 02 12:37:02.714019 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:02.722521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a669f8e2-0acc-4bac-b000-a0d97aac7183 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:02.723976 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a669f8e2-0acc-4bac-b000-a0d97aac7183 tempest-HypervisorAdminNegativeTestJSON-2047678515 tempest-HypervisorAdminNegativeTestJSON-2047678515-project] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.035318 Nov 02 12:37:02.725510 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 309/587] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:02 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:02.736310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:02.738346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:02.752884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.754069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.755539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.756898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.760164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.760986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.817179 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-adbac4fc-6e4c-4526-8b96-53e98b2fd926 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.234340 Nov 02 12:37:02.820975 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 279/588] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:02.839469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:02.846668 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:02.863167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.863666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.864109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:02.864877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:02.865343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:02.865770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.264429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:03.279758 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9b95cceb-322a-4178-ab35-c857d7e06909 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.548529 Nov 02 12:37:03.299673 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 310/589] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:02 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:03.314229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-348fb35a-6eb2-4a5c-b00b-72f7256fa4ef tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Calling method '.version_select at 0x7eff5c790160>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:03.318525 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-348fb35a-6eb2-4a5c-b00b-72f7256fa4ef tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] HTTP exception thrown: Hypervisor with ID '760f7194-44b7-4d06-8114-022daf5d27f5' could not be found. Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-348fb35a-6eb2-4a5c-b00b-72f7256fa4ef tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Request method failure captured: Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-hypervisors/760f7194-44b7-4d06-8114-022daf5d27f5 HTTP/1.1 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRsCiHMM0rLKTdfalWOBrjxsfhv8bL1eFx7ywUrCSTHjm1r9qQiAOMJRFEh5kf_pNf3PcN_wff31emXBfyWeF_bEtmjuW312sGb72MXHPOdA1F952E7Lh85rEPyzoprtzTQSjuKIV5PycIjMWBQ6vhxut_eGJwYfLdJE8LiEZrRIZ8 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a9211ecdb00a45a8abb6d6511f3c1fd7 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:37:03.324017 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a9211ecdb00a45a8abb6d6511f3c1fd7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a9211ecdb00a45a8abb6d6511f3c1fd7"}]}] Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a9211ecdb00a45a8abb6d6511f3c1fd7 Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-494588680 Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a71ed8d0a2b84b62970be869e4ded2cc Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: exception: Hypervisor with ID '760f7194-44b7-4d06-8114-022daf5d27f5' could not be found. Nov 02 12:37:03.325865 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '760f7194-44b7-4d06-8114-022daf5d27f5'} Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi value = int(str(value)) Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '760f7194-44b7-4d06-8114-022daf5d27f5' Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Nov 02 12:37:03.326805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:37:03.329818 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '760f7194-44b7-4d06-8114-022daf5d27f5' could not be found. Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '760f7194-44b7-4d06-8114-022daf5d27f5' could not be found. Nov 02 12:37:03.332726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:03.336065 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-348fb35a-6eb2-4a5c-b00b-72f7256fa4ef tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] Returning 404 to user: Hypervisor with ID '760f7194-44b7-4d06-8114-022daf5d27f5' could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:03.337381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:03.343333 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-348fb35a-6eb2-4a5c-b00b-72f7256fa4ef tempest-HypervisorAdminNegativeTestJSON-494588680 tempest-HypervisorAdminNegativeTestJSON-494588680-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/760f7194-44b7-4d06-8114-022daf5d27f5" status: 404 len: 123 microversion: 2.1 time: 0.037401 Nov 02 12:37:03.351100 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 311/590] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:37:03 2022] GET /compute/v2.1/os-hypervisors/760f7194-44b7-4d06-8114-022daf5d27f5 => generated 123 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:03.352914 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7c539964-3656-4e53-9adc-be6a93576c9a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1462 microversion: 2.1 time: 0.528793 Nov 02 12:37:03.354274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c0f575c0-8e56-4ace-8580-ac9632837aaf tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:03.356311 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 280/591] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:02 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1462 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:03.371592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c0f575c0-8e56-4ace-8580-ac9632837aaf tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:03.382807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:03.387818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:03.403030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.403925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.404566 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.406493 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.407209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.408346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.587389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:03.590049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:03.590592 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:03.596386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:03.596948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:03.661299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c0f575c0-8e56-4ace-8580-ac9632837aaf tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:03.686540 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c0f575c0-8e56-4ace-8580-ac9632837aaf tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1213 microversion: 2.1 time: 0.334113 Nov 02 12:37:03.689426 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 312/592] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:03 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1213 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:03.898161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:03.927002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.927701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.928165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.929030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:03.929496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:03.929930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:03.991041 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cdb8c9a6-d3c1-4b12-bbec-37a8cadbbe57 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 1066 microversion: 2.1 time: 0.614182 Nov 02 12:37:04.005798 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 281/593] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:03 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 1066 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 02 12:37:04.013353 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:04.014866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:04.027132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:04.031810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:04.033175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:04.036618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:04.036618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:04.036618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:04.313128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:04.314064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:04.328354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:04.331345 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:04.333128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:04.350322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:04.355609 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:04.356569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:04.788884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:04.803999 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3144daf4-ebf9-4ab6-a9a4-ac1677f6c4ec tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.796258 Nov 02 12:37:04.813147 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 313/594] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:04 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:04.817093 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2ff83a97-c382-42e9-9972-6cddbb34188e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:04.818193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2ff83a97-c382-42e9-9972-6cddbb34188e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:04.897682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:04.912045 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-149a4b83-753a-4a3c-b062-dc689c4cfd5d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.604976 Nov 02 12:37:04.913031 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 282/595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:04 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:04.941595 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2ff83a97-c382-42e9-9972-6cddbb34188e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:04.967307 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2ff83a97-c382-42e9-9972-6cddbb34188e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1213 microversion: 2.1 time: 0.158031 Nov 02 12:37:04.968475 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 314/596] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:04 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:05.830794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:05.831659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:05.849188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.849699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.850145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:05.850870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:05.851328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:05.851753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.153886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Calling method '.version_select at 0x7eff5c7af700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:06.179838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.181288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.182600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.184638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.186852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.188026 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.246122 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c96d4dc1-5638-4075-9ba2-82aadf0ca681 tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] 10.222.0.64 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.356231 Nov 02 12:37:06.248394 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 315/597] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:37:05 2022] GET /compute/v2.1/limits => generated 511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:06.260291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:06.260979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:06.276534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.277039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.277477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.278201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.280258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.280258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.884870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:06.898713 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a32becfe-7d58-4428-8eb6-a09b86e7a396 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 1.071539 Nov 02 12:37:06.899844 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 283/598] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:05 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:06.906231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:06.916895 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2c19c391-abb9-4f25-9711-7ee03e9a34f7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.667190 Nov 02 12:37:06.919156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:06.920050 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 316/599] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:06 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:06.922197 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:06.931331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1297305445", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:06.939614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.940190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.949908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:06.949908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:06.949908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:06.949908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.043091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:07.132518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:07.153633 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57ec3b89-072c-4a43-988a-591409dbdb61 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1265 microversion: 2.1 time: 0.251301 Nov 02 12:37:07.155207 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 284/600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:06 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:07.703386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Getting quotas for project f06f62ec55ad43f7879d7a8d18071ba8. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:07.711938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Getting quotas for user 843c51faea574f27919b070331f3fe7e and project f06f62ec55ad43f7879d7a8d18071ba8. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:07.731510 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Request method failure captured: Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 1752 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRxb0e2NGJhf8mj3CsIp3zMfl1R8MwOqkZmWxJLiXqvU4jyd-e-762xTCYiyVG83_QVrMcedmtgYdMo7lPSmV0DsBfHkdz7vtvnxmjU7bPlqn2-26uRnnYOBV0RbLCRTQFQ1cxkrrvM0mJeds_POn0A8pKo3R2WuvSoViiOof6ZpuA Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f06f62ec55ad43f7879d7a8d18071ba8 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1860380564 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f06f62ec55ad43f7879d7a8d18071ba8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f06f62ec55ad43f7879d7a8d18071ba8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f06f62ec55ad43f7879d7a8d18071ba8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f06f62ec55ad43f7879d7a8d18071ba8"}]}] Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1860380564 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f06f62ec55ad43f7879d7a8d18071ba8 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1860380564 Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 843c51faea574f27919b070331f3fe7e Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1297305445", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:07.734992 n-d-857339-6 devstack@n-api.service[127767]: exception: Maximum number of metadata items exceeds 128 Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1297305445', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:07.739586 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:07.742170 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-92007e5e-2fb6-4b7b-8f46-003a8417cfbd tempest-AbsoluteLimitsNegativeTestJSON-1860380564 tempest-AbsoluteLimitsNegativeTestJSON-1860380564-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.815714 Nov 02 12:37:07.745319 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 317/601] 10.222.0.64 () {60 vars in 1148 bytes} [Wed Nov 2 12:37:06 2022] POST /compute/v2.1/servers => generated 87 bytes in 824 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:37:07.933681 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:07.934577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:07.944727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.945514 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.946708 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.947609 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.948329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.948454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:07.949209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.949369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:07.963525 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.964173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.964898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:07.966550 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:07.967035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:07.967467 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:08.667658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.679792 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af407ca5-6d5b-49fb-8cef-850b86127415 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.760068 Nov 02 12:37:08.701451 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 285/602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:07 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:08.705279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.710598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:08.713395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:08.716623 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b99d680b-91e6-4fb8-a160-46f3278b8d81 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.773616 Nov 02 12:37:08.718030 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 318/603] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:07 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:08.744963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:08.749923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:08.750379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:08.751239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:08.751643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:08.752064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:08.903397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:08.914873 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bba0ebe6-9712-4a32-9cf8-10a1afd17f80 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1271 microversion: 2.1 time: 0.211731 Nov 02 12:37:08.935889 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 286/604] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:08 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:09.711081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:09.712393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:09.733289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.740583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.740583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.740583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.740583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.743651 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.744338 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:09.745205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:09.756887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.758467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.759129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:09.760587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:09.761230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:09.762960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:10.270612 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.276019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.284082 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e853d3be-6810-4e7a-8d75-bfa45e0d55e5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.546195 Nov 02 12:37:10.287912 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 287/605] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:09 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:10.288670 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5981af42-05c2-492a-b24e-f16126d56076 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.581544 Nov 02 12:37:10.303421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:10.304342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:10.306785 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 319/606] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:09 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:10.320319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:10.321856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:10.322267 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:10.322994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:10.323457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:10.323885 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:10.675199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:10.681689 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e951b2a5-43cf-418f-8208-0583b206da44 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.391891 Nov 02 12:37:10.693630 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 288/607] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:10 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:10.771697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-926696797", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:10.845147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] validate_networks() for [('23e0a14b-01ee-4bd0-a40e-13696a902666', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:11.385728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Calling method '.version_select at 0x7eff5c7d3c10>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.392004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.392550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.392979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.393825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.394286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.394769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc21a418-d705-485c-9f76-b060088e77ad) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:11.403343 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc21a418-d705-485c-9f76-b060088e77ad) Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Request method failure captured: Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 202 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRhwz1DjCngl1_cW3AvKfunK_rZdYh3CxOZj_hS59fc4gSqLCemRilmUfcW0MfkIMkgFfFdgaqByiX0b655hQwe2c8HmCMZ6UYQFjJPPpQwru1MbNeih8IruptjqUltJVK5EqLWQXkpZ6NmsBGDe1ZnpN6BzfHpc33T9W8hvTQkYqc Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_57ab8b7723184d3e9eff5809eafffb20", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}] Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9379cc116a1e4896b7df09dcfa75eb4f Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-LiveMigrationTest-server-926696797", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}]}} Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-926696797', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '23e0a14b-01ee-4bd0-a40e-13696a902666'}]}}} Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:11.407252 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:11.423826 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-fc21a418-d705-485c-9f76-b060088e77ad) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d635277b-3d2f-4a2e-a3dd-e3f6c45963fb tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.099447 Nov 02 12:37:11.437426 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 320/608] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1103 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:37:11.447975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:11.448211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5657e408-c6af-4b09-ad7a-f20fcc1aeba8", "name": "network-vif-plugged", "status": "completed", "tag": "1b059224-13f3-4473-b9fb-179846b9a3cd"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:11.451023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.451775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.452421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.458303 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1596ed45-467d-49da-8bec-87722d2e7cf4 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.762660 Nov 02 12:37:11.458977 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 289/609] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:37:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:11.470383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.470383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.479005 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] Creating event network-vif-plugged:1b059224-13f3-4473-b9fb-179846b9a3cd for instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 on n-h2-857339-6 Nov 02 12:37:11.479598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.479598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.479598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.480062 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-06bf4045-a6c1-4009-b7fd-ff2179657499 req-77c75949-ca3c-4d70-8396-e43ed90f57ff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067276 Nov 02 12:37:11.480178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.480611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.481042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.483884 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 321/610] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:11.490961 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.491684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.499902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.500678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.501346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.502248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.503030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.504086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.858591 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:11.869033 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-77b98ebb-afac-4505-b3c6-03f32ef9b9bd tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.408926 Nov 02 12:37:11.873926 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 290/611] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.897941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:11.908471 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c6da338-af4f-4ce2-b4d1-f44a341e1f81 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.423192 Nov 02 12:37:11.911268 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 322/612] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:11.922382 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d5c1d6-abf8-4b74-91e4-c784a14c3456", "tag": "67a405c2-b0d9-48f6-8c2a-19bfbd05f80e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:11.933895 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.934818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.935425 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.948565 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] Creating event network-changed:67a405c2-b0d9-48f6-8c2a-19bfbd05f80e for instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 on n-h1-857339-6 Nov 02 12:37:11.954464 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-9f38c487-bada-4d03-8415-44061f649b0b req-5047f780-c605-4351-890a-a79bde05f002 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041764 Nov 02 12:37:11.962127 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 323/613] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:11.969208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:11.969618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:11.976143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.977489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.978106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:11.979022 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:11.979639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:11.980785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:12.300206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.310403 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d6440709-9a4f-4fd6-a149-c8583bf63f8d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.350193 Nov 02 12:37:12.311241 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 324/614] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:12.316413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-732059977", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.436085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f2a7d398-00ea-4f1f-b5fe-f69392bff6a6 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Calling method '.version_select at 0x7eff5c6f5160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.439960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f2a7d398-00ea-4f1f-b5fe-f69392bff6a6 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f2a7d398-00ea-4f1f-b5fe-f69392bff6a6 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.443408 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Nov 02 12:37:12.447463 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.449927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f2a7d398-00ea-4f1f-b5fe-f69392bff6a6 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.451337 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f2a7d398-00ea-4f1f-b5fe-f69392bff6a6 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.575714 Nov 02 12:37:12.452547 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 291/615] 10.222.0.64 () {58 vars in 1128 bytes} [Wed Nov 2 12:37:11 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 578 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.475334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-423dbaa5-53e9-45bc-9d58-e85d2130240d tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Calling method '.version_select at 0x7eff5c6df940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.487001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] validate_networks() for [('23e0a14b-01ee-4bd0-a40e-13696a902666', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:12.505237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-423dbaa5-53e9-45bc-9d58-e85d2130240d tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-423dbaa5-53e9-45bc-9d58-e85d2130240d tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/n-d-857339-6/reboot HTTP/1.1 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6'} Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.521326 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-423dbaa5-53e9-45bc-9d58-e85d2130240d tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.526526 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-423dbaa5-53e9-45bc-9d58-e85d2130240d tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-d-857339-6/reboot" status: 403 len: 111 microversion: 2.1 time: 0.060285 Nov 02 12:37:12.530618 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 292/616] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/n-d-857339-6/reboot => generated 111 bytes in 70 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.538104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:12.548143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1acd0e2e-319d-411b-b2bf-006ef59e265e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Calling method '.version_select at 0x7eff5c6dfee0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.561809 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1acd0e2e-319d-411b-b2bf-006ef59e265e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1acd0e2e-319d-411b-b2bf-006ef59e265e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.564113 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1acd0e2e-319d-411b-b2bf-006ef59e265e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1acd0e2e-319d-411b-b2bf-006ef59e265e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.029602 Nov 02 12:37:12.568635 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 293/617] 10.222.0.64 () {58 vars in 1212 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:37:12.589992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-191c6333-61fb-427a-8c9f-217b64c31413 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Calling method '.version_select at 0x7eff5c6c40d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.592302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-191c6333-61fb-427a-8c9f-217b64c31413 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-191c6333-61fb-427a-8c9f-217b64c31413 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/n-d-857339-6 HTTP/1.1 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6'} Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.596346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Nov 02 12:37:12.601537 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.603636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-191c6333-61fb-427a-8c9f-217b64c31413 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.605684 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-191c6333-61fb-427a-8c9f-217b64c31413 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-d-857339-6" status: 403 len: 109 microversion: 2.1 time: 0.025169 Nov 02 12:37:12.607436 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 294/618] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/n-d-857339-6 => generated 109 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.629871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c138bf1e-a1fb-435d-a861-265318651d27 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Calling method '.version_select at 0x7eff5c6f5280>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.652894 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-c138bf1e-a1fb-435d-a861-265318651d27 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c138bf1e-a1fb-435d-a861-265318651d27 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.655805 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c138bf1e-a1fb-435d-a861-265318651d27 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.659733 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c138bf1e-a1fb-435d-a861-265318651d27 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.043684 Nov 02 12:37:12.664889 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 295/619] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:37:12.671739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bf0e262-1565-4c9f-aca4-1d607f90ca34 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Calling method '.version_select at 0x7eff5c6c48b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.674261 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4bf0e262-1565-4c9f-aca4-1d607f90ca34 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bf0e262-1565-4c9f-aca4-1d607f90ca34 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/n-d-857339-6/shutdown HTTP/1.1 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6'} Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.676976 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Nov 02 12:37:12.681565 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.683301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bf0e262-1565-4c9f-aca4-1d607f90ca34 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.684416 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4bf0e262-1565-4c9f-aca4-1d607f90ca34 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-d-857339-6/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.018436 Nov 02 12:37:12.694582 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 296/620] 10.222.0.64 () {58 vars in 1194 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/n-d-857339-6/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.701341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15a2a873-15d7-4543-801d-fc5d126d44a9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Calling method '.version_select at 0x7eff5c6df280>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.715278 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-15a2a873-15d7-4543-801d-fc5d126d44a9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15a2a873-15d7-4543-801d-fc5d126d44a9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.717751 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15a2a873-15d7-4543-801d-fc5d126d44a9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-15a2a873-15d7-4543-801d-fc5d126d44a9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.022394 Nov 02 12:37:12.728569 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 297/621] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:37:12.741351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ce9f166e-563a-4240-bb83-f0560cdb0089 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Calling method '.version_select at 0x7eff5c6c41f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.743959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ce9f166e-563a-4240-bb83-f0560cdb0089 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ce9f166e-563a-4240-bb83-f0560cdb0089 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/n-d-857339-6/startup HTTP/1.1 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6'} Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.747146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ce9f166e-563a-4240-bb83-f0560cdb0089 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.759948 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ce9f166e-563a-4240-bb83-f0560cdb0089 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "GET /compute/v2.1/os-hosts/n-d-857339-6/startup" status: 403 len: 110 microversion: 2.1 time: 0.012422 Nov 02 12:37:12.762711 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 298/622] 10.222.0.64 () {58 vars in 1191 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/n-d-857339-6/startup => generated 110 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.768386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-61aa73a8-6e98-43a7-9bb3-5dccba433df9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Calling method '.version_select at 0x7eff5c6f5820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.780195 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-61aa73a8-6e98-43a7-9bb3-5dccba433df9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-61aa73a8-6e98-43a7-9bb3-5dccba433df9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'nonexistent_hostname'} Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.782496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-61aa73a8-6e98-43a7-9bb3-5dccba433df9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-61aa73a8-6e98-43a7-9bb3-5dccba433df9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.020318 Nov 02 12:37:12.796313 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 299/623] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:37:12.810291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d45a3e0a-04d8-45c4-90b2-9af0053555c8 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6c4d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d45a3e0a-04d8-45c4-90b2-9af0053555c8 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-hosts/n-d-857339-6 HTTP/1.1 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 51 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: {"status": "enable", "maintenance_mode": "invalid"} Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:37:12.815651 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d45a3e0a-04d8-45c4-90b2-9af0053555c8 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d45a3e0a-04d8-45c4-90b2-9af0053555c8 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-hosts/n-d-857339-6" status: 400 len: 199 microversion: 2.1 time: 0.025186 Nov 02 12:37:12.829678 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 300/624] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:37:12 2022] PUT /compute/v2.1/os-hosts/n-d-857339-6 => generated 199 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:37:12.834966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-de94b555-847b-4271-809e-7fabe75dc43e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6f5160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-de94b555-847b-4271-809e-7fabe75dc43e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-hosts/n-d-857339-6 HTTP/1.1 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 51 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: {"status": "invalid", "maintenance_mode": "enable"} Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:37:12.846099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-de94b555-847b-4271-809e-7fabe75dc43e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.850303 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-de94b555-847b-4271-809e-7fabe75dc43e tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-hosts/n-d-857339-6" status: 400 len: 189 microversion: 2.1 time: 0.017040 Nov 02 12:37:12.853180 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 301/625] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:37:12 2022] PUT /compute/v2.1/os-hosts/n-d-857339-6 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:37:12.872109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f31aac1-1dcb-4bcb-8df4-4b865be76879 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Action: 'update', calling method: .version_select at 0x7eff5c6c43a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.876213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4f31aac1-1dcb-4bcb-8df4-4b865be76879 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '9eb4cb2eb6f54baab042f88d4c718705', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4614501647ac42bd9f10f9e8256f7e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f31aac1-1dcb-4bcb-8df4-4b865be76879 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Request method failure captured: Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-hosts/n-d-857339-6 HTTP/1.1 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 50 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRzWSwwiO3ZjeMNXYihZX88HK0ur0dhua9jnbDuPKUjatTBwZKItTOaV5_zQx2OiTonLplJurco9b35iUfvGcH44vcZyWd5TlM0hEJ11fxJSB6VODgDcRJRUTlRpIi4flEoUo7ayw6OOQuGFx0DrIatXOuOO_a0zea15Uqt_OagrnQ Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4614501647ac42bd9f10f9e8256f7e9a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4614501647ac42bd9f10f9e8256f7e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4614501647ac42bd9f10f9e8256f7e9a"}]}] Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4614501647ac42bd9f10f9e8256f7e9a Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-689811511 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9eb4cb2eb6f54baab042f88d4c718705 Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-689811511-project Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:37:12.884109 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f31aac1-1dcb-4bcb-8df4-4b865be76879 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4f31aac1-1dcb-4bcb-8df4-4b865be76879 tempest-HostsAdminNegativeTestJSON-689811511 tempest-HostsAdminNegativeTestJSON-689811511-project] 10.222.0.64 "PUT /compute/v2.1/os-hosts/n-d-857339-6" status: 403 len: 111 microversion: 2.1 time: 0.028571 Nov 02 12:37:12.889115 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 302/626] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:37:12 2022] PUT /compute/v2.1/os-hosts/n-d-857339-6 => generated 111 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:12.895970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dbbf2793-4253-41b4-a9d4-0a38809c21f0 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6f5b80>, body: {"status": null, "maintenance_mode": null} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dbbf2793-4253-41b4-a9d4-0a38809c21f0 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-hosts/n-d-857339-6 HTTP/1.1 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 42 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: {"status": null, "maintenance_mode": null} Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'n-d-857339-6', 'body': {'status': None, 'maintenance_mode': None}} Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'disable', Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Enable', Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'Disable', Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'ENABLE', Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'DISABLE'], Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi None Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:37:12.900723 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dbbf2793-4253-41b4-a9d4-0a38809c21f0 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dbbf2793-4253-41b4-a9d4-0a38809c21f0 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-hosts/n-d-857339-6" status: 400 len: 127 microversion: 2.1 time: 0.010323 Nov 02 12:37:12.906162 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 303/627] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:37:12 2022] PUT /compute/v2.1/os-hosts/n-d-857339-6 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:37:12.913431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:12.914183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:12.922473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:12.923523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:12.923523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:12.924442 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:12.925152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:12.925572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.110193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:13.119468 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c7a968ff-74cb-457e-8278-92c86801c449 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1313 microversion: 2.1 time: 0.215316 Nov 02 12:37:13.120321 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 304/628] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:12 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:13.125581 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6f58b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:13.129278 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.hosts [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Enabling host nonexistent_hostname. Nov 02 12:37:13.140231 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Request method failure captured: Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 50 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR293sp8ZGTCJ5Li1uBLt89QLg7PgkxC4ntDv49w_qXgYP9UbY_RO6AwJcJYdr0lgOtnOsTD4PAJCOv7tFnQTwuDFGZzsJdVJnZAMmA44OgFl_05lgr79-cwl_0Be7CLAkADJgM3Y9Wq1x_M324lJjUJds4SX3ycNOHRIyzGszI_9s Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4bcace4cff73419496f326310091e2eb", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4bcace4cff73419496f326310091e2eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4bcace4cff73419496f326310091e2eb"}]}] Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4bcace4cff73419496f326310091e2eb Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-821801207 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bec84816c31434c910aecaadd180784 Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-HostsAdminNegativeTestJSON-821801207-project-admin Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: {"status": "enable", "maintenance_mode": "enable"} Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: exception: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:13.142577 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Nov 02 12:37:13.146369 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.149526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:13.150481 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4b4c06f4-a4ec-4272-b857-62bb87547fa9 tempest-HostsAdminNegativeTestJSON-821801207 tempest-HostsAdminNegativeTestJSON-821801207-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028943 Nov 02 12:37:13.151201 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 305/629] 10.222.0.64 () {60 vars in 1211 bytes} [Wed Nov 2 12:37:13 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:37:13.159099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:13.159802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:13.167662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.171003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.171003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.171003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.171003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.171003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462c3b03-afac-49d3-abd9-9ceb54a6384b) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:13.218142 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462c3b03-afac-49d3-abd9-9ceb54a6384b) Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Request method failure captured: Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 202 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRhwz1DjCngl1_cW3AvKfunK_rZdYh3CxOZj_hS59fc4gSqLCemRilmUfcW0MfkIMkgFfFdgaqByiX0b655hQwe2c8HmCMZ6UYQFjJPPpQwru1MbNeih8IruptjqUltJVK5EqLWQXkpZ6NmsBGDe1ZnpN6BzfHpc33T9W8hvTQkYqc Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_57ab8b7723184d3e9eff5809eafffb20", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}] Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9379cc116a1e4896b7df09dcfa75eb4f Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-LiveMigrationTest-server-732059977", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}]}} Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-732059977', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '23e0a14b-01ee-4bd0-a40e-13696a902666'}]}}} Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:13.221795 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:13.230092 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462c3b03-afac-49d3-abd9-9ceb54a6384b) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:13.233247 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-61bbcc13-b4ad-4c41-942f-a006ba9dcdd0 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.910492 Nov 02 12:37:13.236963 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 325/630] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 922 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:37:13.244076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c49cb716-207f-41d7-b76b-673226767e98 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Action: 'create', calling method: .version_select at 0x7eff5c712700>, body: {"keypair": {"name": "tempest-keypair-957997551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHChhsbxhJOPTn+rSobG4rAX8AszXP8wDe0vQzR0Oap2Gq+/EgzfTQ5nBeJ7NAI8envBo0HEqv+fKlf6uRGHxn/zf2mwlgQOE8rjZ+9C0hAmJqvHLgHznWSz7z0qpyokQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:13.272279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c49cb716-207f-41d7-b76b-673226767e98 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Getting quotas for project 57ab8b7723184d3e9eff5809eafffb20. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:13.277391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c49cb716-207f-41d7-b76b-673226767e98 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Getting quotas for user 9379cc116a1e4896b7df09dcfa75eb4f and project 57ab8b7723184d3e9eff5809eafffb20. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:13.427993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:13.437372 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-86096145-2f10-403d-bc04-91d2d6071240 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.284896 Nov 02 12:37:13.438375 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 306/631] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:13 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:13.441560 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c49cb716-207f-41d7-b76b-673226767e98 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.203400 Nov 02 12:37:13.442338 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 326/632] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:37:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:13.456557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:13.458934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:13.471508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:13.626308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:13.636736 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a60fb391-93a2-452a-9fe7-1caf31b39e21 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.197650 Nov 02 12:37:13.640758 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 307/633] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:13 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:14.150702 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.152431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.165344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.166680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.167986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.170800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.171799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.172692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.471089 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.473198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.494429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.495253 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.497540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.497540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.503902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.507304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.800407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:14.813837 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dff47cb2-ea04-462d-9b49-e2a2b2035fc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1462 microversion: 2.1 time: 0.672293 Nov 02 12:37:14.817230 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 327/634] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:14 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1462 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:14.827835 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:14.830024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:14.842530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.844628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.845704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:14.847463 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:14.849058 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:14.850532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.011504 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:15.023318 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aa874870-9190-46f5-887c-771305bc162c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.560368 Nov 02 12:37:15.049442 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 308/635] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:14 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:15.075877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.081285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.098206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.100675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.102647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.105858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.108914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.110423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.253645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:15.263133 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-75a56673-a990-427d-b7d9-19bec4cd3db3 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.443101 Nov 02 12:37:15.277782 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 328/636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:14 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:15.385646 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ffa6dbe2-df16-463b-8c4e-4a6709822025 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1613 microversion: 2.1 time: 0.326910 Nov 02 12:37:15.388955 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 309/637] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:15 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1613 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:15.434121 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:15.436222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.452665 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.455412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.458706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.465528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.467992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.469794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:15.607030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda) Nov 02 12:37:15.610185 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.612462 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:15.612462 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Request method failure captured: Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8/action HTTP/1.1 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 15 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQLx3IDTZGxhKhLI9_nRs10rIjiqd_Qi3cmGMashjMAvq5IPa3RJVmTSj0OUGJWp7NuUar8RJkxsfLoRqdMrY3fQHb0Xk4FqxPoUjRQ8yNKtt_kjJ9aUpkTrdeqjfjQ_VQ_aPgzd-7B2JlyVQoP8_pU8jYFEuwSKnCg4gHiCeUe6Uc Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2046c3ec9ae24830ac6194791d986f0d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2046c3ec9ae24830ac6194791d986f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2046c3ec9ae24830ac6194791d986f0d"}]}] Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-293810145 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2046c3ec9ae24830ac6194791d986f0d Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-293810145 Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 1f30f86e527d484fa6f592b13e4c081d Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-293810145-project-admin Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: {"migrate": {}} Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '5657e408-c6af-4b09-ad7a-f20fcc1aeba8', 'body': {'migrate': {}}} Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:15.616442 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ab471831-f6e3-4af1-a6dc-fb9e0a2dcdda) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:15.622680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c7358c1-cb91-4dbb-8b3a-d7218c56d969 tempest-MigrationsAdminTest-293810145 tempest-MigrationsAdminTest-293810145-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8/action" status: 500 len: 214 microversion: 2.1 time: 0.190889 Nov 02 12:37:15.631850 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 329/638] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:15 2022] POST /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8/action => generated 214 bytes in 192 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:37:15.643012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:15.644304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:15.654511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.655522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.656400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.657719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:15.658261 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:15.658855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:15.694753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:16.056350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.057630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:16.064520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.065257 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.065865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.067395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.068145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.068806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.118714 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e6ac227f-7fdd-49af-9dd5-39f8945b7fa2 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 204 len: 0 microversion: 2.1 time: 0.481906 Nov 02 12:37:16.120387 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 310/639] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:15 2022] DELETE /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:16.129339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.138153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:16.146943 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.150045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.150515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.151252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.151716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.152139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.220432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:16.405003 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:16.416239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:16.416608 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d7b14848-d859-4247-80bd-628f6f1bfa08 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.364065 Nov 02 12:37:16.427293 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6b64bc50-d282-41f9-91bc-e3236adf06c7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1468 microversion: 2.1 time: 0.301482 Nov 02 12:37:16.435077 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 330/640] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:16 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:16.437525 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 311/641] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:16 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:16.444838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:16.445559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:16.455290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.455290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.455574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.456533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.457374 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.457968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.636339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:16.644576 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-929200420", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:16.653098 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fc266d52-0d56-4e64-b7ff-b2032d0295f2 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.212513 Nov 02 12:37:16.670151 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 312/642] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:16 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:16.678945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=94,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:16.723759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:16.909832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d5c1d6-abf8-4b74-91e4-c784a14c3456", "name": "network-vif-plugged", "status": "completed", "tag": "67a405c2-b0d9-48f6-8c2a-19bfbd05f80e"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:16.924108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:16.924723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:16.925208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:16.939176 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] Creating event network-vif-plugged:67a405c2-b0d9-48f6-8c2a-19bfbd05f80e for instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 on n-h1-857339-6 Nov 02 12:37:16.945061 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-3bcd1c2d-5fa6-4a5d-8469-7358cc646a40 req-e1e56b75-a3ef-4a9f-aed2-fa36b967ae66 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047475 Nov 02 12:37:16.951226 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 313/643] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:17.006931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:17.007364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:17.008418 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:17.009062 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:17.009488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:17.055386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.066109 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.066109 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.072073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.075041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.077619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.145381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Getting quotas for project b2967018bbd64629a9a49c051c3d1e60. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:17.151590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Getting quotas for user fd9a2cf92b094c54bdce2e0bf8903af3 and project b2967018bbd64629a9a49c051c3d1e60. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:17.166669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:17.169219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:17.309000 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3b415ec6-8d0b-4487-a81a-cf8bb19ededf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.872229 Nov 02 12:37:17.311328 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 331/644] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:17.325659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-19d2856e-d494-41c2-9081-b1ef64fe78a6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:17.326905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-19d2856e-d494-41c2-9081-b1ef64fe78a6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:17.421161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-19d2856e-d494-41c2-9081-b1ef64fe78a6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:17.439868 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-19d2856e-d494-41c2-9081-b1ef64fe78a6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1218 microversion: 2.1 time: 0.114900 Nov 02 12:37:17.439868 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 314/645] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:17 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:17.453658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:17.454670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:17.463629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.464730 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.465898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.467203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.467960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.468724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.471448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:17.472245 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:17.542625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.542625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.542625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:17.543174 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:17.543677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:17.547026 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.290079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:18.299459 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c128be88-06b8-4dd5-a11a-92eade9efbf8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.862045 Nov 02 12:37:18.325958 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 332/646] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:17 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:18.330823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:18.331555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:18.341639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.354499 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.358076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.370565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:18.370565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:18.370565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:18.475140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:18.489304 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-37d84fa1-55a7-417b-ac16-94e1fd55ecc6 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1468 microversion: 2.1 time: 1.025672 Nov 02 12:37:18.491060 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 315/647] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:17 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1468 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:18.509533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3a2cf965-aea8-457e-9e14-9129b8b2ebbb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:18.510614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3a2cf965-aea8-457e-9e14-9129b8b2ebbb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:18.638460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3a2cf965-aea8-457e-9e14-9129b8b2ebbb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:18.648667 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3a2cf965-aea8-457e-9e14-9129b8b2ebbb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1218 microversion: 2.1 time: 0.156259 Nov 02 12:37:18.651965 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 316/648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:18 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1218 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:19.066908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.083299 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d84aacf-a671-47b9-9de4-f2447533dcf9 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1313 microversion: 2.1 time: 0.767732 Nov 02 12:37:19.096970 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 333/649] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:18 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:19.337642 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:19.338556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:19.346207 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.346852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.351958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.351958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.351958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.351958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.521629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:19.522783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:19.535041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.536608 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.539849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.541363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.542504 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.542969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.813825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.827100 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-21c5261f-ded3-4fb8-9b83-04e5a7e85056 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1426 microversion: 2.1 time: 0.309447 Nov 02 12:37:19.850449 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 334/650] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1426 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:19.860020 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:19.862196 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:19.876254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:19.878306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.886260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.887063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.888135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:19.888948 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:19.889640 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:19.889755 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-deb48809-2d42-4ec7-90c4-462e2d05291e tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.555995 Nov 02 12:37:19.890398 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 317/651] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:19.917332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:19.919214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-612469946", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}], "security_groups": [{"name": "tempest-securitygroup--1663349838"}], "key_name": "tempest-keypair-957997551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:20.025004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:20.047563 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a6be6bc6-247c-4c4e-bcb7-b1a2ccf9617c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1222 microversion: 2.1 time: 0.192466 Nov 02 12:37:20.054116 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 335/652] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:19 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:20.069244 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5657e408-c6af-4b09-ad7a-f20fcc1aeba8", "name": "network-vif-deleted", "tag": "1b059224-13f3-4473-b9fb-179846b9a3cd"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:20.112993 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.113516 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.113964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.154952 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] Creating event network-vif-deleted:1b059224-13f3-4473-b9fb-179846b9a3cd for instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 on n-h2-857339-6 Nov 02 12:37:20.157057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] validate_networks() for [('23e0a14b-01ee-4bd0-a40e-13696a902666', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:20.172883 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-29ec65fd-ac32-4f45-8b2a-3d38f9cbc72d req-729f8d36-3090-44f5-9460-302ed1739c40 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120073 Nov 02 12:37:20.181467 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 336/653] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:20.201256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:20.201256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:20.236787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.237307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.238484 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.239227 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.239959 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.246122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.748245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:20.765898 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3664e971-9f98-43b6-862a-ddf6eaa45a9d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1463 microversion: 2.1 time: 0.583079 Nov 02 12:37:20.767348 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 337/654] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:20 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1463 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-890d2f90-4e91-451e-b947-d71fbcf0c651) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:20.850216 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-890d2f90-4e91-451e-b947-d71fbcf0c651) Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Request method failure captured: Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 456 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRhwz1DjCngl1_cW3AvKfunK_rZdYh3CxOZj_hS59fc4gSqLCemRilmUfcW0MfkIMkgFfFdgaqByiX0b655hQwe2c8HmCMZ6UYQFjJPPpQwru1MbNeih8IruptjqUltJVK5EqLWQXkpZ6NmsBGDe1ZnpN6BzfHpc33T9W8hvTQkYqc Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_57ab8b7723184d3e9eff5809eafffb20", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}] Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9379cc116a1e4896b7df09dcfa75eb4f Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveMigrationTest-1779573083-project Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveMigrationTest-server-612469946", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}], "security_groups": [{"name": "tempest-securitygroup--1663349838"}], "key_name": "tempest-keypair-957997551", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:20.855780 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-612469946', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '23e0a14b-01ee-4bd0-a40e-13696a902666'}], 'security_groups': [{'name': 'tempest-securitygroup--1663349838'}], 'key_name': 'tempest-keypair-957997551', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:20.860782 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-890d2f90-4e91-451e-b947-d71fbcf0c651) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-41c2fb73-2bab-4c95-9cb8-e4095d796420 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.953911 Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 318/655] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 960 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:37:20.866633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:20.874238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:20.874459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:20.889933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.890582 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.901184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.901184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.901184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.901184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.943542 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:20.944031 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:20.944564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:20.945062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lazy-loading 'fault' on Instance uuid 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:21.064888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:21.080399 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-24fd071a-2ea0-460e-b1bc-326514430448 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1303 microversion: 2.1 time: 0.227957 Nov 02 12:37:21.099977 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 319/656] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:20 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:21.099977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.099977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.116454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.117552 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.117995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.118727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.119188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.119623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.389639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:21.400889 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7a3a4900-0d77-42d5-83d2-cec7ffd2a192 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.313578 Nov 02 12:37:21.407462 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 320/657] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:21.415870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.438377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.440686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:21.456393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.457156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.457663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.462326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.462986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.463490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.511596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Calling method '.version_select at 0x7eff5d02d310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.526137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.526637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.527290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.547941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.548580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.549028 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.583818 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f48524cc-5815-4ef3-b1db-33af0e21be41 tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage/b94df274ea1b4a2387fa8a717cb3ca3b?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644" status: 200 len: 694 microversion: 2.1 time: 0.791314 Nov 02 12:37:21.584936 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 338/658] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Nov 2 12:37:20 2022] GET /compute/v2.1/os-simple-tenant-usage/b94df274ea1b4a2387fa8a717cb3ca3b?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644 => generated 694 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:21.618615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '.version_select at 0x7eff5c790a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.647700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.652067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.652893 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.667256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:21.671176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.671671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.672113 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.682671 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-de4e774a-b296-45de-a40a-d01aa708d3d8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1214 microversion: 2.1 time: 0.273968 Nov 02 12:37:21.687857 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 321/659] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:21.704292 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-af12f936-1a98-4ac8-9e59-2f71a29b7865 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage/b94df274ea1b4a2387fa8a717cb3ca3b?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644" status: 200 len: 694 microversion: 2.1 time: 0.095500 Nov 02 12:37:21.705174 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 339/660] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/os-simple-tenant-usage/b94df274ea1b4a2387fa8a717cb3ca3b?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:21.747171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Calling method '.version_select at 0x7eff5c6f59d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.764700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.768142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.768142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.848871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.850205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.850769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.863252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:21.901889 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8656e3aa-5faf-4d60-8c8e-794f239e40be tempest-TenantUsagesTestJSON-1967982892 tempest-TenantUsagesTestJSON-1967982892-project-admin] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644&detailed=1" status: 200 len: 5700 microversion: 2.1 time: 0.158558 Nov 02 12:37:21.903868 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 322/661] 10.222.0.64 () {58 vars in 1335 bytes} [Wed Nov 2 12:37:21 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A37%3A20.787644&end=2022-11-03T12%3A37%3A20.787644&detailed=1 => generated 5700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:21.931427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:21.932032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:21.947339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.950510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.953332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:21.953332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:21.954577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:21.958861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.037015 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:22.121164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:22.121842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:22.146128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.146901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.148449 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.152229 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.153123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.154437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.228092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.229058 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.229771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.230627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lazy-loading 'fault' on Instance uuid 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:22.357997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:22.365553 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ecd4c777-9736-4b9c-bf4f-87f759b85c26 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 200 len: 1303 microversion: 2.1 time: 0.253413 Nov 02 12:37:22.369555 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 323/662] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:22 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:22.443206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:22.444116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:22.457987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.458804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.459400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.460276 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.460990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.461575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.664695 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1fb2659f-445c-4861-a828-d2eef8a546da tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "DELETE /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 204 len: 0 microversion: 2.1 time: 0.739274 Nov 02 12:37:22.665608 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 340/663] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:21 2022] DELETE /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:22.680040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:22.680782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:22.696709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.697224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.697672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.698395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:22.698965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:22.699409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:22.950930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:22.963480 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ef3ede33-3ba0-406d-81e4-496e7e1bf10a tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.523900 Nov 02 12:37:22.964951 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 324/664] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:22 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.018163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:23.033436 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de51c5ce-9da7-44a7-b047-50ed9d1f030d tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1469 microversion: 2.1 time: 0.355607 Nov 02 12:37:23.033436 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 341/665] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:22 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.038513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.039891 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:23.046700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.047443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.048036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.048938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.049557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.050177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.163292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5c8384c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.165835 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.166657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.167331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.183954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.184861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.186450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.200352 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.201357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.202050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.210073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:23.240709 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d7ff265d-c57c-4cc3-9f20-96ae5f1e0594 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.248127 Nov 02 12:37:23.240709 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 325/666] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:23.241063 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c2dd945-224a-4eb2-8fcf-c278bfe3a5a1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1270 microversion: 2.1 time: 0.187198 Nov 02 12:37:23.241063 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 342/667] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1270 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.258197 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5c6f5550>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.261006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.261700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.262301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.301823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.302178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.302619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.322358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.323025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.324623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.337260 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-40fa69ee-a126-4dca-b2ca-4562ad86ce3c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.088652 Nov 02 12:37:23.353179 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 326/668] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:23.356224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5c8c63a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.358384 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.359125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.359756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.383202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.383202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.383202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.400668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.401439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.402123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.402968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.403760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 5657e408-c6af-4b09-ad7a-f20fcc1aeba8] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:23.410972 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-38142f4f-90bc-4ef3-ac3e-2202d9c38c1b tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059162 Nov 02 12:37:23.412942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.413896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.414798 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.415895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.416660 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.417359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.418430 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 343/669] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:23.424143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5d02d670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.426554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.427951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.428782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.449975 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. Nov 02 12:37:23.452066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.452603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.453106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 HTTP/1.1 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '5657e408-c6af-4b09-ad7a-f20fcc1aeba8'} Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:23.454998 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. Nov 02 12:37:23.461823 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:23.464040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 404 to user: Instance 5657e408-c6af-4b09-ad7a-f20fcc1aeba8 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:23.465349 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6d845f12-59e4-4cc3-a3fd-ca2c8a46e639 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8" status: 404 len: 111 microversion: 2.1 time: 0.076087 Nov 02 12:37:23.465517 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d106e5c8-f2da-4d2d-9429-6adb5d183eb6 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.045624 Nov 02 12:37:23.466597 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 327/670] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/servers/5657e408-c6af-4b09-ad7a-f20fcc1aeba8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:37:23.482361 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 344/671] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:23.503595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.503897 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-95c335f7-f5fd-4309-8ce9-8bff4d341bdc tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5c7a2af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.504144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:23.505524 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95c335f7-f5fd-4309-8ce9-8bff4d341bdc tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.506134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95c335f7-f5fd-4309-8ce9-8bff4d341bdc tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.506740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-95c335f7-f5fd-4309-8ce9-8bff4d341bdc tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.516854 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.518193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.519300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.520885 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.522005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.523214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.545908 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-95c335f7-f5fd-4309-8ce9-8bff4d341bdc tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.046289 Nov 02 12:37:23.554875 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 345/672] 10.222.0.64 () {58 vars in 1179 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:23.578257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:23.581460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5d1ad040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.583486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.584370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.585337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.609013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.609845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.610699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.626409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.627692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.628525 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.637532 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b60a1f16-a61e-491d-a65b-38b088dd7c6c tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.065172 Nov 02 12:37:23.638734 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 346/673] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:23.661849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5ca5a280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.668128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.668573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.669131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.717594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.718100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.718548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.748904 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-151eeccc-17f4-4668-b9a1-43a3f151f66e tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.098373 Nov 02 12:37:23.751501 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 347/674] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:23.777771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5d0898b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.780286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.780791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.781238 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.805569 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.806448 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.807172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.819554 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a9d6d388-16b6-4c7a-9502-b443a7a7a195 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.047112 Nov 02 12:37:23.821118 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 348/675] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:23.843274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Calling method '.version_select at 0x7eff5cc1ca60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:23.849441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.850641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.853223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.877383 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.878152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.878939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:23.903019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:23.903019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:23.903019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.077132 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a3ef0320-67a9-41d9-9b6a-0be31a0b9e26 tempest-HypervisorAdminTestJSON-19947521 tempest-HypervisorAdminTestJSON-19947521-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.240843 Nov 02 12:37:24.079736 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 349/676] 10.222.0.64 () {58 vars in 1173 bytes} [Wed Nov 2 12:37:23 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:24.103273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:24.109055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:24.169376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.171119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:24.177273 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-12f83557-bf20-4af0-9bc7-03cab780e70b tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 204 len: 0 microversion: 2.1 time: 0.676692 Nov 02 12:37:24.182551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.182551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.182551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:24.182551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.183256 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 328/677] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:23 2022] DELETE /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:24.222480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:24.228600 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:24.247048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.252652 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:24.255058 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.262840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:24.264905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:24.266226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:24.955190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:24.973062 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1d2bd248-f6f7-4b2d-bf06-5e5b5443f100 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.891036 Nov 02 12:37:24.974320 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 350/678] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:24 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:24.989137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:24.990150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:25.003692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.004539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.014269 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.015346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.016281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.016986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.163757 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:25.186368 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-76d1ad56-9e98-40ef-9d49-9cf29dade481 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1469 microversion: 2.1 time: 1.000253 Nov 02 12:37:25.188147 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 329/679] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:24 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1469 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:25.193321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:25.194258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:25.204028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.213953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.213953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.213953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:25.213953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:25.213953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:25.567292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:25.590706 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-79e271b4-3ec0-42c8-88d9-ab8d8cd35722 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1276 microversion: 2.1 time: 0.401186 Nov 02 12:37:25.591653 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 330/680] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:25 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1276 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:25.784434 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:25.808451 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8256dc60-7cca-4de0-afe7-24720e11bc09 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1535 microversion: 2.1 time: 0.829939 Nov 02 12:37:25.808451 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 351/681] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:24 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1535 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:26.003038 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:26.005603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:26.027195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.028090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.028787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:26.030825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.031560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.032204 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:26.212836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:26.213518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:26.223757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.224268 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.224755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:26.225523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:26.226540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:26.238207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.159940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=20 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:27.672970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:27.720564 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-136d2df3-ef55-4fa8-a9d6-2fe43ea07250 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 1.721155 Nov 02 12:37:27.740702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 331/682] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:25 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:27.770763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:27.771819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:27.792386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:27.812464 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bbac58ab-1ba4-4833-992a-002b386328b7 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1469 microversion: 2.1 time: 1.603727 Nov 02 12:37:27.821929 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.822889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.832092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.833553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.835072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.835072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.840828 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 352/683] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:26 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1469 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:27.846061 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:27.846725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:27.870317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:28.257634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:28.273952 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2f978c2b-e114-4b70-894f-5eb0f1daac66 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1276 microversion: 2.1 time: 0.529298 Nov 02 12:37:28.274621 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 332/684] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:27 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1276 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:28.479172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d5c1d6-abf8-4b74-91e4-c784a14c3456", "name": "network-vif-deleted", "tag": "67a405c2-b0d9-48f6-8c2a-19bfbd05f80e"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:28.522658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:28.528874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:28.532165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:28.622112 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] Creating event network-vif-deleted:67a405c2-b0d9-48f6-8c2a-19bfbd05f80e for instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 on n-h1-857339-6 Nov 02 12:37:28.656692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:28.670180 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-765fcd4c-da91-4700-9688-753f48d98477 req-b3c3c886-c11a-4ad4-9bc8-aeed376ab1da service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193400 Nov 02 12:37:28.673325 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 333/685] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:28.760885 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:28.761745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:28.794821 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:28.795645 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:28.796125 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:28.807511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:28.808025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:28.808472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:28.989719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:28.997983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:29.005466 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4cd11f74-7c9a-4345-a8fe-4bb87742d032 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1535 microversion: 2.1 time: 1.163373 Nov 02 12:37:29.008654 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 353/686] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:27 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1535 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.030068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:29.031120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:29.041539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.042395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.044440 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.050673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.051741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.052458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.139153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.140723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.142004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.143781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lazy-loading 'fault' on Instance uuid 30d5c1d6-abf8-4b74-91e4-c784a14c3456 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:29.749791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbede44ae7194b4e97bc67e0dc8207b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b94df274ea1b4a2387fa8a717cb3ca3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:29.767022 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-99271120-21cd-4af0-b9fb-a9fb694b7f8e tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 200 len: 1303 microversion: 2.1 time: 0.756731 Nov 02 12:37:29.771991 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 354/687] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:29 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 1303 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:29.799686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:29.801162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:29.826391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.827538 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.828203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:29.829578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:29.830242 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:29.832851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.311152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:30.337971 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e55aba7d-f757-4ca0-9ba9-9a2ea291c84e tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1276 microversion: 2.1 time: 0.547053 Nov 02 12:37:30.341214 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 355/688] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:29 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1276 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:30.372362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:30.382932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:30.401157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.402354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.403510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.408584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.409839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.413905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.619304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.620053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.620887 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.621895 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lazy-loading 'fault' on Instance uuid 98d9d819-116f-405e-b1e3-216d7fdc4818 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:30.897942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:30.910799 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-15a57a6a-5e8c-475a-9164-8ce9804ba839 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 2.153956 Nov 02 12:37:30.916074 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 334/689] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:28 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:30.927928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d9d819-116f-405e-b1e3-216d7fdc4818", "name": "network-vif-deleted", "tag": "31495a98-f7a4-46d6-91fd-f475392a374c"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:30.954049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:30.961345 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:30.962008 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:30.962636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:30.985160 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-af5d7ec7-7778-46a8-8094-e39c8eea8fb5 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 200 len: 1369 microversion: 2.1 time: 0.629096 Nov 02 12:37:30.991955 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 356/690] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:30 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 1369 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:30.998935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:30.999998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] [instance: 30d5c1d6-abf8-4b74-91e4-c784a14c3456] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:31.011727 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] Creating event network-vif-deleted:31495a98-f7a4-46d6-91fd-f475392a374c for instance 98d9d819-116f-405e-b1e3-216d7fdc4818 on n-h2-857339-6 Nov 02 12:37:31.036731 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-9a3929d0-dd37-49b4-a41b-8e8552855340 req-b45e16b8-68b8-4ecb-b25d-c26e7a1630b9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119095 Nov 02 12:37:31.044673 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 335/691] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:31.048856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.049389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.049847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.050726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.051300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.051705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.121935 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] HTTP exception thrown: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Request method failure captured: Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 HTTP/1.1 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmRpTOJjtZuQyLdWbzgVv4UKR8UGwqzMrWbBYSJS8VuQQfZGIaxNyWStzTF0BXIidJ69ufZIV4krlp8r10xXYQkjOkFPczNOl6WLhlGzzQkPMLLPBwRBlBDsKSD1p8l1saJ1kAsOsgkmUQPAAKyjU1LfvGo4dZd9_oTy_KRdh0NaCQw Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: b94df274ea1b4a2387fa8a717cb3ca3b Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TenantUsagesTestJSON-795251783 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b94df274ea1b4a2387fa8a717cb3ca3b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94df274ea1b4a2387fa8a717cb3ca3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b94df274ea1b4a2387fa8a717cb3ca3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b94df274ea1b4a2387fa8a717cb3ca3b"}]}] Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TenantUsagesTestJSON-795251783 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: b94df274ea1b4a2387fa8a717cb3ca3b Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TenantUsagesTestJSON-795251783 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TenantUsagesTestJSON-795251783-project Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bbede44ae7194b4e97bc67e0dc8207b3 Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TenantUsagesTestJSON-795251783-project Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '30d5c1d6-abf8-4b74-91e4-c784a14c3456'} Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:31.124053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] Returning 404 to user: Instance 30d5c1d6-abf8-4b74-91e4-c784a14c3456 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d8db988c-9bc2-4f9c-9c01-27a562dd5554 tempest-TenantUsagesTestJSON-795251783 tempest-TenantUsagesTestJSON-795251783-project] 10.222.0.64 "GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456" status: 404 len: 111 microversion: 2.1 time: 0.131191 Nov 02 12:37:31.140408 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 357/692] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:30 2022] GET /compute/v2.1/servers/30d5c1d6-abf8-4b74-91e4-c784a14c3456 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:31.385513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:31.386531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:31.414058 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.417632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.418195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.419125 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.419953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.421067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.950765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:31.952132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:31.974452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=6 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:31.976682 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.977478 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.978035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:31.979102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:31.980115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:31.981157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.553559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:32.567610 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2723bf72-a9b4-4e8b-b2c6-098fff5cedff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 1.200982 Nov 02 12:37:32.581060 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 336/693] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:31 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:32.603640 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:32.604715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 98d9d819-116f-405e-b1e3-216d7fdc4818] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.615434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.616047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.616629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.617623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.618351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.622715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.660867 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 HTTP/1.1 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '98d9d819-116f-405e-b1e3-216d7fdc4818'} Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:32.662853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 404 to user: Instance 98d9d819-116f-405e-b1e3-216d7fdc4818 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8ce31413-390a-4afb-9b44-7515fc207965 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818" status: 404 len: 111 microversion: 2.1 time: 0.084218 Nov 02 12:37:32.675654 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 337/694] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:32 2022] GET /compute/v2.1/servers/98d9d819-116f-405e-b1e3-216d7fdc4818 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:32.689614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:32.689614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:32.706407 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.707321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.708009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.709080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:32.709817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:32.711234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:32.755257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:32.825315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:32.839516 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-591baa9e-b293-4fca-8b65-50b6bcc4fe8f tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 0.893312 Nov 02 12:37:32.843840 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 358/695] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:31 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:32.908936 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.309610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.320740 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-75ef89d2-f3b6-49be-ae4f-92606e71f7f1 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 204 len: 0 microversion: 2.1 time: 0.639548 Nov 02 12:37:33.320740 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 338/696] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:32 2022] DELETE /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:37:33.330994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.350304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.387799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.395556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.399223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.406146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.408468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.410568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.612822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.614651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.651893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.656052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.661122 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.662999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.669478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.670847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.075531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:34.125190 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c40d3f25-bf5c-48a7-a6a4-48f06e70e0ba tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1469 microversion: 2.1 time: 0.802848 Nov 02 12:37:34.135370 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 359/697] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:33 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1469 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:34.163587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:34.168286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:34.215539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.216817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.226407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.227742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.231818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.234223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.804162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:34.816622 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6719e14e-d9c1-4ce9-9af0-8058e31a5f54 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 1.218590 Nov 02 12:37:34.817744 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 339/698] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:33 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:35.160295 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:35.161315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:35.187332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.190414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.192615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.195502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.203365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.204550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.655647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:35.727844 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-85480f6b-9fc1-4820-aafc-55531d8175f8 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 1.587333 Nov 02 12:37:35.738128 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 360/699] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:34 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:35.840227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:35.871748 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:35.877112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:35.918761 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-497b00cb-b70f-49f1-ac01-b56033812dd7 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1469 microversion: 2.1 time: 0.732808 Nov 02 12:37:35.922961 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 340/700] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:35 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1469 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:35.925753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.933555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.937117 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.938713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.947186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.952585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.779479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:36.780361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:36.792347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.793189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.794556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.795523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.797162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.801657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.934740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:37.958705 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8daaca33-e0aa-4f1e-a942-e08d89665e25 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 2.093476 Nov 02 12:37:37.974542 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 361/701] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:35 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:38.001260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:38.002342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:38.018857 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.020573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.021241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:38.023160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.023816 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.024612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:38.471832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:38.501015 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-002e565d-6078-4c86-810c-279eb466334c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1471 microversion: 2.1 time: 1.718481 Nov 02 12:37:38.506737 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 341/702] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:36 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1471 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:38.539222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4521dc35-0cae-430d-931d-42a0f646819e", "tag": "15e01b94-9395-4454-959a-f1ee02b69b22"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:38.597977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:38.609849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e598f7cb-31b6-40b6-95bb-4a5b50f14c50 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 200 len: 1427 microversion: 2.1 time: 0.621477 Nov 02 12:37:38.622446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.627689 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.635439 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 362/703] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:37 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 1427 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:38.641957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:38.686643 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] Creating event network-changed:15e01b94-9395-4454-959a-f1ee02b69b22 for instance 4521dc35-0cae-430d-931d-42a0f646819e on n-h2-857339-6 Nov 02 12:37:38.714855 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-3afc56b2-648e-40d3-9fae-9e12f84f2e06 req-5479de50-fe49-4db6-8b7b-14f08d3ead35 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204262 Nov 02 12:37:38.720229 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 342/704] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:38.997551 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:39.011309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:39.045006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.047076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.057662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.062196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.063173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.069395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.252227 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-43f62f5c-44da-4fda-8629-81a2c116b286 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c8ab8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-916312112", "description": "tempest-description-913546091"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:39.952092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:39.988747 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-27e84304-b1a6-46a0-89e3-c261088d5ddf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.974554 Nov 02 12:37:39.993770 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 343/705] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:38 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:40.015175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.023766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.053108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.053654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.067134 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.069795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.074102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.074102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.549764 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-43f62f5c-44da-4fda-8629-81a2c116b286 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.874255 Nov 02 12:37:40.559411 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 363/706] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:38 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:40.562621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.564133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: 99c15163-d75c-45bd-8a07-f7d7b7d37455] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.589575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:40.589873 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.590458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.591045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.592392 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.594296 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.595977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.609776 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b88d39ed-bb4f-4de4-94fb-b3bd067081b0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1477 microversion: 2.1 time: 0.606329 Nov 02 12:37:40.620886 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 344/707] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:39 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1477 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:40.629285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-unplugged", "status": "completed", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:40.652730 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. Nov 02 12:37:40.658642 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.661505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.662121 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 HTTP/1.1 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '99c15163-d75c-45bd-8a07-f7d7b7d37455'} Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:40.667273 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. Nov 02 12:37:40.671089 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:40.674793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 404 to user: Instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:40.676602 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-adbb2af5-e476-4819-8a3d-5f7f2e9325cc tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455" status: 404 len: 111 microversion: 2.1 time: 0.124125 Nov 02 12:37:40.680860 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 364/708] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:40 2022] GET /compute/v2.1/servers/99c15163-d75c-45bd-8a07-f7d7b7d37455 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:40.692857 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-375b1fcb-d5d8-43e1-9855-916e298ad102 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5d14bb80>, body: {"security_group_rule": {"parent_group_id": "21d0808e-ecbe-4e46-b64f-a86195cf7ea3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:40.713816 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] Creating event network-vif-unplugged:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:37:40.728108 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-a0424ada-21bb-4971-9523-9d9e8eea048d req-5a451f01-34e6-4b6a-b521-929868f09125 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108726 Nov 02 12:37:40.731360 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 345/709] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:40.740959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.747516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.764599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.768521 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.770398 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.784346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.786248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.788852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.866758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:41.870760 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-19178950-6dfb-434f-b729-a95fc7441b3d tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 204 len: 0 microversion: 2.1 time: 1.137008 Nov 02 12:37:41.872916 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 346/710] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:40 2022] DELETE /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:41.884692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c15163-d75c-45bd-8a07-f7d7b7d37455", "name": "network-vif-deleted", "tag": "4fd2315f-3bee-4c55-9a39-5f59138d2385"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:41.900256 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-375b1fcb-d5d8-43e1-9855-916e298ad102 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.217756 Nov 02 12:37:41.910536 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 365/711] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:40 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:41.916698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.917808 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.921696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.922203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.922647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.933761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.939974 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.940872 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.941812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.942442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.943286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.965544 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] Creating event network-vif-deleted:4fd2315f-3bee-4c55-9a39-5f59138d2385 for instance 99c15163-d75c-45bd-8a07-f7d7b7d37455 on n-h1-857339-6 Nov 02 12:37:41.981488 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-da524c96-b063-4ace-a4dc-b02c7e2e04e0 req-e931bb7d-9728-42d8-94fc-b1ae9e7c29f9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106794 Nov 02 12:37:41.994541 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 347/712] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:42.485941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Calling method '.version_select at 0x7eff5c7321f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.488021 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.488568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.489017 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.508527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:42.529800 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a9a03b48-e3e8-4b28-a3ce-8befd8c5398c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.617786 Nov 02 12:37:42.531018 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 366/713] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:42.536419 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.537382 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.545594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.546541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.547415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.548854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.549500 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.550111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.569971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.570475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.570918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.592659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.593273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.593772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.602062 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c537ff12-2bc7-449b-a561-ca692644d407 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.605785 Nov 02 12:37:42.603147 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 348/714] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:42.700957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80d5a891-b7cb-4bad-8481-8293c6f68229 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.723001 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-80d5a891-b7cb-4bad-8481-8293c6f68229 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.115181 Nov 02 12:37:42.740874 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 349/715] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:42.758252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.759000 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.775233 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.775766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.776212 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.777062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.777491 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.777915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.833595 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:42.848062 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-494bbd41-26ce-4c4a-82d2-84d18e46d096 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1477 microversion: 2.1 time: 0.315615 Nov 02 12:37:42.861549 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 367/716] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1477 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:42.883259 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d0e83993-ec76-4f09-899b-292095aa30a3 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c6cf8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1325771733", "description": "tempest-description-1027071205"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:43.066027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:43.080224 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2cb02c46-39be-48fd-aaff-98f5e29704eb tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1467 microversion: 2.1 time: 0.337755 Nov 02 12:37:43.089677 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 350/717] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1467 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:43.113366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Calling method '.version_select at 0x7eff5c7260d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:43.125814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.136308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.140728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.235483 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.236079 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.246691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.258109 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7d19babb-303b-4ae2-bf68-17d5ae959ff8 tempest-HypervisorAdminV228Test-1159106251 tempest-HypervisorAdminV228Test-1159106251-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.164401 Nov 02 12:37:43.272093 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 351/718] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:37:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:43.499051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-plugged", "status": "completed", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:43.536660 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.547577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.547577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.597262 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] Creating event network-vif-plugged:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:37:43.604214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d0e83993-ec76-4f09-899b-292095aa30a3 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.741330 Nov 02 12:37:43.605793 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 368/719] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:42 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:43.618279 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-e321d376-3603-4802-9582-3a57b42010c9 req-da7b2500-80d8-45b1-bd22-36d1c77e885b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132489 Nov 02 12:37:43.620745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:43.620745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:43.621051 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 352/720] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:43.631893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb690dfe-6781-45ab-874a-fe8d57555748 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c7324c0>, body: {"security_group_rule": {"parent_group_id": "74a2e67b-ed65-4c3c-bd0b-8ce87232214d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:43.641494 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.642000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.642454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.643187 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.643649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.644076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:44.043177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:44.070576 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b0f7baf4-50bd-4258-9060-31a6eef663e4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.457339 Nov 02 12:37:44.096819 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 369/721] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:43 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:44.132091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:44.132091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:44.172458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:44.174063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.174577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.198733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:44.201838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.202428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.202882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.396756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.415634 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1168f76d-3da3-4d18-bfd1-a5d57c910eb0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1477 microversion: 2.1 time: 1.318134 Nov 02 12:37:45.416783 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 370/722] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:44 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1477 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:45.427646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:45.429668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.445205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.446043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.447811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.450242 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.451075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.451934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.819853 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb690dfe-6781-45ab-874a-fe8d57555748 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.195042 Nov 02 12:37:45.831036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.837587 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 353/723] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:43 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:45.842351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:45.845429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.859175 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-39e77ab1-bde3-4946-907a-89ac29c2af53 tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1467 microversion: 2.1 time: 0.435048 Nov 02 12:37:45.862279 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 371/724] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:45 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1467 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:45.865855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.866384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.866868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.867658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.868100 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.868700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.877155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-939090336", "imageRef": "c8ddf862-9901-40fb-8ff9-ef9f93ae3812", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:46.010764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:46.273496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:46.294827 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7a9f387b-c622-457c-8919-9638f5b85bfa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.456249 Nov 02 12:37:46.295717 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 354/725] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:45 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:46.300837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-490a7cf7-e224-4939-9631-e4ee521788ec tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c6c45e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-826054399", "description": "tempest-description-1947819190"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] HTTP exception thrown: Flavor's memory is too small for requested image. Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] Request method failure captured: Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 142 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmSVEYItxp6KwA8rTYI2cFQJ9cM10yAq9o7b-jp9HC_VEpwG0fvniH63r2eP07nyGUcwehfZpxjq1p-Q9cerpsUyDG96C1GbfyKJKT0FA-TtjSvjqV3xITFY60YEVCgjKi46WR2YTz4lw0LKVRrY2HGJeH6L-1kF5knHsLcPM0z11zU Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a2dcc600abea496b91b87b0b2b8364d9 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FlavorsV2NegativeTest-1197071702 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a2dcc600abea496b91b87b0b2b8364d9", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a2dcc600abea496b91b87b0b2b8364d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a2dcc600abea496b91b87b0b2b8364d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a2dcc600abea496b91b87b0b2b8364d9"}]}] Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FlavorsV2NegativeTest-1197071702 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a2dcc600abea496b91b87b0b2b8364d9 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1197071702 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FlavorsV2NegativeTest-1197071702-project Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: b573bd1cba424377adcd053a1d27a833 Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FlavorsV2NegativeTest-1197071702-project Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-939090336", "imageRef": "c8ddf862-9901-40fb-8ff9-ef9f93ae3812", "flavorRef": "452"}} Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: exception: Flavor's memory is too small for requested image. Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-939090336', 'imageRef': 'c8ddf862-9901-40fb-8ff9-ef9f93ae3812', 'flavorRef': '452'}}} Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:46.392899 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-94d44550-428a-4b39-b4d6-783f428cb9d6 tempest-FlavorsV2NegativeTest-1197071702 tempest-FlavorsV2NegativeTest-1197071702-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.530034 Nov 02 12:37:46.398983 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 372/726] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:45 2022] POST /compute/v2.1/servers => generated 93 bytes in 532 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:37:46.401940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b675eccd-9fed-4d65-b56b-80a0f46b523f", "name": "network-vif-deleted", "tag": "df5c0c04-c31c-4b89-89ec-fb14f2763e26"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:46.412952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.413432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.415088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.428227 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] Creating event network-vif-deleted:df5c0c04-c31c-4b89-89ec-fb14f2763e26 for instance b675eccd-9fed-4d65-b56b-80a0f46b523f on n-h1-857339-6 Nov 02 12:37:46.436337 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-5edc3175-beb9-4a1c-a324-7174d55b26cb req-11a1af4f-949f-40c2-b1f3-3a2b31a5dc0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039726 Nov 02 12:37:46.438653 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 373/727] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:46.463438 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:46.464169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:46.472075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.472885 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.473520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.474380 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.474846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.475793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.738705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:46.756913 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-abe09187-e89d-40c0-8e6b-02ff1a101dd1 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1462 microversion: 2.1 time: 0.299164 Nov 02 12:37:46.758305 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 374/728] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:46 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1462 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:46.794197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:46.796925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:46.803303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.804059 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.804504 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.805217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.805676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.806100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.839053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:47.464277 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8b898ec5-7518-4ca5-9aae-45da6fadd3fe tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 0 microversion: 2.1 time: 0.677465 Nov 02 12:37:47.465621 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 375/729] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:46 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 0 bytes in 680 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:47.481186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:47.481853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:47.500835 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.501383 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.501880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.502669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.503133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.503565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.564720 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-490a7cf7-e224-4939-9631-e4ee521788ec tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.259058 Nov 02 12:37:47.564720 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 355/730] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:47.564720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:47.564720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:47.590213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.590213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.590213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.591029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.591506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.592093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.609762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.611711 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.612207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.612765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lazy-loading 'fault' on Instance uuid b675eccd-9fed-4d65-b56b-80a0f46b523f {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:47.687986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '976993a09f2342c68dab07da6a7dd236', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9929679b00cb4db39002b1ae432a2539', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:47.702652 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c6f549be-efef-4182-95dc-2b770941559e tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 200 len: 1302 microversion: 2.1 time: 0.235847 Nov 02 12:37:47.704659 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 376/731] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:47 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 1302 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:47.728474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:47.728474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:47.755575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.756295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.757554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.758585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.759270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.760549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.825337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.826215 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.832728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.838427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lazy-loading 'fault' on Instance uuid 63d0ddc9-7d7b-463a-9055-b118b37d85c1 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:48.016680 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:48.031514 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8febb52d-3cb7-4793-a7e8-15527db26aff tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.473668 Nov 02 12:37:48.032198 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 356/732] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:47 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:48.041763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2d95aa4a-89d0-4e19-96d4-b87d8315bdb6 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c7f2dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2075221702", "description": "tempest-description-256680478"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:48.140050 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-692539da-105a-48e9-8b65-3195327cfdb9 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1596 microversion: 2.1 time: 0.430057 Nov 02 12:37:48.155030 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 377/733] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:47 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1596 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:48.170215 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:48.172913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:48.188690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.189917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.190635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.191416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.191959 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.192390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.705196 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fcd2e819-2adb-4923-9d8d-e5a025b5b051 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action" status: 202 len: 0 microversion: 2.1 time: 0.537835 Nov 02 12:37:48.707120 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 378/734] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:37:48 2022] POST /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:48.712822 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2d95aa4a-89d0-4e19-96d4-b87d8315bdb6 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.679099 Nov 02 12:37:48.713399 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 357/735] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:48 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:48.719508 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:48.720567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:48.729231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f20d3704-726d-4cc5-a281-8ec0bdd73adf tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c7328b0>, body: {"security_group_rule": {"parent_group_id": "0cfda707-a744-4f65-8266-399a555c5e8a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "511f9c7b-ed8b-41e1-8c44-eb0c1f436ce2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:48.744649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.745500 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.746110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.747034 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.747721 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.748473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.111956 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3f848115-9ea6-4255-b14b-dd47da332be0 tempest-ServersAdminTestJSON-1340291624 tempest-ServersAdminTestJSON-1340291624-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1613 microversion: 2.1 time: 0.395138 Nov 02 12:37:49.114359 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 379/736] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:48 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1613 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:49.133006 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:49.135657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] [instance: b675eccd-9fed-4d65-b56b-80a0f46b523f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.150019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.151176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.152623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.153568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.161614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.163089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.206537 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] HTTP exception thrown: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Request method failure captured: Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f HTTP/1.1 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQKFVpwv1PoDPDJemFjUY9Yqj9cijOzoIQVuigMUXuzbmrMga3S8dLuOrU0fCLEzqKPy5QLxioR5Snp82ct8DAnq5UcYsx32gcvO56_3izSn8lckIKtStF-ArvXm8zYVC5JCixQlNDTM4Icj5Wv-mWmRhctTjnfLHpKLqJl4Hm-y1Y Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9929679b00cb4db39002b1ae432a2539", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9929679b00cb4db39002b1ae432a2539"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9929679b00cb4db39002b1ae432a2539"}]}] Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MigrationsAdminTest-610977 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9929679b00cb4db39002b1ae432a2539 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MigrationsAdminTest-610977 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 976993a09f2342c68dab07da6a7dd236 Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MigrationsAdminTest-610977-project Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'b675eccd-9fed-4d65-b56b-80a0f46b523f'} Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:49.209264 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] Returning 404 to user: Instance b675eccd-9fed-4d65-b56b-80a0f46b523f could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2b370604-97da-4ff3-956c-49bc3df58d6c tempest-MigrationsAdminTest-610977 tempest-MigrationsAdminTest-610977-project] 10.222.0.64 "GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f" status: 404 len: 111 microversion: 2.1 time: 0.095479 Nov 02 12:37:49.217948 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 380/737] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:49 2022] GET /compute/v2.1/servers/b675eccd-9fed-4d65-b56b-80a0f46b523f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:49.239740 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:49.241864 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.260114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.266013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.267904 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.271057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.271556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.272038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.791145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:49.806463 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-52df6980-003e-4798-8aca-552670e7bb68 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.591448 Nov 02 12:37:49.812836 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 381/738] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:49 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:49.825421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:49.826265 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.841245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.847286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.847286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.847286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.847286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.847286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.917911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:50.081133 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f20d3704-726d-4cc5-a281-8ec0bdd73adf tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.358036 Nov 02 12:37:50.083457 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 358/739] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:48 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:50.088187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4521dc35-0cae-430d-931d-42a0f646819e", "name": "network-vif-plugged", "status": "completed", "tag": "15e01b94-9395-4454-959a-f1ee02b69b22"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:50.098646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:50.106368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.106845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.107467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.122516 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] Creating event network-vif-plugged:15e01b94-9395-4454-959a-f1ee02b69b22 for instance 4521dc35-0cae-430d-931d-42a0f646819e on n-h2-857339-6 Nov 02 12:37:50.129815 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-378a11e2-1b43-4791-9555-35c7c85d5309 req-f9d6cb02-1d35-4c4f-b640-67d253fb5fee service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045985 Nov 02 12:37:50.136669 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 359/740] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:50.145619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-62b6a48a-cdca-41cd-b3b2-55c612c2c13c tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c726820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1887593479", "description": "tempest-description-1048042952"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:50.551612 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d7b55d76-0d63-4d50-8425-4316ed698d25 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 204 len: 0 microversion: 2.1 time: 0.742710 Nov 02 12:37:50.553463 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 382/741] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:49 2022] DELETE /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:50.563433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:50.565065 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:50.582695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.583250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.586163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.587834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.589751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.592198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.072248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:51.085522 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-05e3d367-cd32-4afe-9bf2-cf2ba246d639 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1469 microversion: 2.1 time: 0.526700 Nov 02 12:37:51.087013 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 383/742] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:50 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:51.092743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:51.093432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:51.114815 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.115438 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.116083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.117063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.117592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.120772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.305564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:51.317481 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ed6fec14-6df3-44e0-9f20-ecf3f599465d tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1318 microversion: 2.1 time: 0.229268 Nov 02 12:37:51.318073 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 384/743] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:51 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:51.464088 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-62b6a48a-cdca-41cd-b3b2-55c612c2c13c tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.324943 Nov 02 12:37:51.465776 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 360/744] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:50 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:51.488987 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ab974885-281c-4c3f-8a2b-05f4ac9e1a8c tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5d089ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-448471834", "description": "tempest-description-975842091"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:52.116602 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:52.118453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:52.130516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.131655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.132334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.133606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.134291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.135214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.304292 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ab974885-281c-4c3f-8a2b-05f4ac9e1a8c tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.823726 Nov 02 12:37:52.305282 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 385/745] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:52.341292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6722d9f8-8d51-4eb9-b15a-e356c66342ad tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c6cf4c0>, body: {"security_group_rule": {"parent_group_id": "a8d55670-b40a-4977-b74b-2e9b87abc207", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "541e02e1-4534-4802-851c-5d4ba860c004"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:52.511650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:52.532407 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-587f98d0-24c5-4769-a64e-63abacf4bdce tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1469 microversion: 2.1 time: 0.422482 Nov 02 12:37:52.538465 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 361/746] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:52 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1469 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:52.546187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:52.559836 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:52.574513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.576984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.578684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.581854 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.582719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.583406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.071282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.083974 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3da74ec1-a959-431c-87c2-c47400a84bee tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1467 microversion: 2.1 time: 0.545462 Nov 02 12:37:53.084706 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 362/747] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:52 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1467 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:53.717027 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6722d9f8-8d51-4eb9-b15a-e356c66342ad tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.402412 Nov 02 12:37:53.720531 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 386/748] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:52 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:53.733630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:53.734453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:53.761626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.769110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.769963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.773944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.776848 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.778713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.023360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-152571181", "block_migration": true, "disk_over_commit": false}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:54.027199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:54.035428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:54.042154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.042697 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.043348 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.044137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.046898 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.047559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.049318 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-28bf4665-49db-43ef-831a-7c278cb840be tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 200 len: 1427 microversion: 2.1 time: 0.327282 Nov 02 12:37:54.051326 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 387/749] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:53 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 1427 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:54.057104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37360133-c05a-4a0a-811c-74beb3a6c7ff tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5d272af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.180294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:54.468474 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37360133-c05a-4a0a-811c-74beb3a6c7ff tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/541e02e1-4534-4802-851c-5d4ba860c004" status: 202 len: 0 microversion: 2.1 time: 0.415554 Nov 02 12:37:54.472218 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 388/750] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:37:54 2022] DELETE /compute/v2.1/os-security-groups/541e02e1-4534-4802-851c-5d4ba860c004 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:54.484190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c232408a-2db9-4b25-b804-8792615c1d99", "name": "network-vif-deleted", "tag": "fb604afe-95f1-4593-9fa2-2ef9bef29837"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:54.539658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95f13192-9161-47c2-9e9d-8b138903dee8) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:54.547045 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95f13192-9161-47c2-9e9d-8b138903dee8) Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Request method failure captured: Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e/action HTTP/1.1 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 106 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR7SAqqvX6EiIiFa9xSOvp8YFc2thufeCq8Djml880ljwBO0FoFWRv6iBkkhU59uPyqQVemBuI-qk78EjBCxLWUnutya5LT4lhkH1eMDWqGHEhAsNvWaoeokXCYzkfl6UyMmJl8_oamAm8nz_YYXX9zG-qPK0J7LcIwscgY35z9It4 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f6d4fa85f0fc497f96bf3533a0b98c1f Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6d4fa85f0fc497f96bf3533a0b98c1f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}] Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f6d4fa85f0fc497f96bf3533a0b98c1f Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveMigrationNegativeTest-1943197550-project-admin Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8f7ae91cc1a34bfcab5a04fd57e8a2c2 Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveMigrationNegativeTest-1943197550-project-admin Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: {"os-migrateLive": {"host": "tempest-host-152571181", "block_migration": true, "disk_over_commit": false}} Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '4521dc35-0cae-430d-931d-42a0f646819e', 'body': {'os-migrateLive': {'host': 'tempest-host-152571181', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:54.550404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:37:54.557489 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95f13192-9161-47c2-9e9d-8b138903dee8) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:54.574368 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6f83a181-2a8f-4cdf-bab6-43638f3c2add tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e/action" status: 500 len: 214 microversion: 2.1 time: 1.440225 Nov 02 12:37:54.576342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.576425 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 363/751] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Nov 2 12:37:53 2022] POST /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e/action => generated 214 bytes in 1441 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:37:54.576520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.596742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a0440f4f-9cda-439f-baf5-87f3f264373f tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c726700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.638371 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] Creating event network-vif-deleted:fb604afe-95f1-4593-9fa2-2ef9bef29837 for instance c232408a-2db9-4b25-b804-8792615c1d99 on n-h1-857339-6 Nov 02 12:37:54.661175 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-bea46cdb-d30b-4507-96bc-b33d2d1720fb req-7f61dc40-7fe4-4208-bdd3-c20338e7f058 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183354 Nov 02 12:37:54.661175 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 389/752] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:54.742980 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a0440f4f-9cda-439f-baf5-87f3f264373f tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/a8d55670-b40a-4977-b74b-2e9b87abc207" status: 200 len: 248 microversion: 2.1 time: 0.162377 Nov 02 12:37:54.744891 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 364/753] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:37:54 2022] GET /compute/v2.1/os-security-groups/a8d55670-b40a-4977-b74b-2e9b87abc207 => generated 248 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:54.763514 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca7ed89a-f9dc-440f-b42e-0bc715d66a12 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c9159d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-534656109", "description": "tempest-description-703256024"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:54.926003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-971266226", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:55.057993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:55.749743 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca7ed89a-f9dc-440f-b42e-0bc715d66a12 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.993308 Nov 02 12:37:55.750765 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 390/754] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:37:54 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:55.763229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:55.763992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: c232408a-2db9-4b25-b804-8792615c1d99] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:55.783940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.784443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.784920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.789699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.789699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.789699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.829665 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] HTTP exception thrown: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Request method failure captured: Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 HTTP/1.1 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQNPiGqcjl6ebjtJ9LekmY4S6J-5YIZun-o5Y5yNpPOWarm5vNwgxWKjNtec8PtnSLcgvtOtybGGhBdKa-Aij5VBKQTuWc730z4BFQ8MYS0UKULi3AfWaRwNV_Gvjg-ggAhMmuOecavPj7nV9Eouz5vZT9MItwajxFOkfrvZH5c0_s Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e09079e89384417879f678c0a4df5c2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}] Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a0475d03f0e14972a733ba9db2d32947 Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'c232408a-2db9-4b25-b804-8792615c1d99'} Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:55.832954 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. Nov 02 12:37:55.837931 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:37:55.839540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Returning 404 to user: Instance c232408a-2db9-4b25-b804-8792615c1d99 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:55.841527 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-874bc78b-82b9-4019-9feb-62af62367a18 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99" status: 404 len: 111 microversion: 2.1 time: 0.089661 Nov 02 12:37:55.843137 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 391/755] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:55 2022] GET /compute/v2.1/servers/c232408a-2db9-4b25-b804-8792615c1d99 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:56.187617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:56.188167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:56.188522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:56.189269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:56.194921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:56.254771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.257741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.257741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.257741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.265653 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.266111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.342071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Getting quotas for project b2967018bbd64629a9a49c051c3d1e60. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:56.358105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Getting quotas for user fd9a2cf92b094c54bdce2e0bf8903af3 and project b2967018bbd64629a9a49c051c3d1e60. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:56.399653 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:56.403504 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:56.544400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-983494d2-db97-447c-a1ef-31ca63b7da45 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] Calling method '.version_select at 0x7eff5c915e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.577764 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-983494d2-db97-447c-a1ef-31ca63b7da45 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.732456 Nov 02 12:37:56.579734 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 392/756] 10.222.0.64 () {60 vars in 1226 bytes} [Wed Nov 2 12:37:55 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:56.590452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aaa53ba4-0c5f-44ea-86e5-0dbb8d29a381 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5d14b430>, body: {"security_group_rule": {"parent_group_id": "a4345a20-f46a-46a0-b066-b453b6dcbb42", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:56.629933 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7a4ab1b5-0999-4919-b498-6a7b51b2feaa tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709391 Nov 02 12:37:56.630692 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 365/757] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:37:56.670639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.673541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.701168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.701761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.702240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.702989 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.705958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.706516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.772928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:57.214444 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d169c550-eca0-4577-8ccb-e354d90db1a0 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 204 len: 0 microversion: 2.1 time: 0.569593 Nov 02 12:37:57.215080 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 366/758] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:56 2022] DELETE /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:57.224401 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ce9022db-0318-4b37-9b2b-f208a9d5cae8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c7f2e50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:58.070064 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aaa53ba4-0c5f-44ea-86e5-0dbb8d29a381 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.488268 Nov 02 12:37:58.078487 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 393/759] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:58.094533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1b7345fb-d80e-4f98-bb3b-2e77d2d5e970 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:58.095176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1b7345fb-d80e-4f98-bb3b-2e77d2d5e970 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:58.230821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1b7345fb-d80e-4f98-bb3b-2e77d2d5e970 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:58.242563 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1b7345fb-d80e-4f98-bb3b-2e77d2d5e970 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1218 microversion: 2.1 time: 0.162649 Nov 02 12:37:58.243782 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 394/760] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:58 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:58.261552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:58.262343 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:58.279927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.283696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.284286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.285310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.287868 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.291650 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.406385 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ce9022db-0318-4b37-9b2b-f208a9d5cae8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 1.186198 Nov 02 12:37:58.408448 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 367/761] 10.222.0.64 () {62 vars in 1247 bytes} [Wed Nov 2 12:37:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:58.425869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-870ba6d7-3ca9-423f-910e-9fdcf1fc00fc tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Action: 'create', calling method: .version_select at 0x7eff5c890280>, body: {"security_group_rule": {"parent_group_id": "a4345a20-f46a-46a0-b066-b453b6dcbb42", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:58.762442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:58.770546 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-85fce6e3-57a1-422d-9580-f7d5a14993ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1470 microversion: 2.1 time: 0.515194 Nov 02 12:37:58.789740 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 395/762] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:58 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1470 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:58.797818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-384e3782-52be-4d79-af31-bb4452cb64c8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] Calling method '.version_select at 0x7eff5cd04790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:58.810988 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-384e3782-52be-4d79-af31-bb4452cb64c8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019793 Nov 02 12:37:58.813005 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 396/763] 10.222.0.64 () {60 vars in 1226 bytes} [Wed Nov 2 12:37:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:58.831085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9ede046c-307f-42ef-a835-61813331d3a8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c712940>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:59.664060 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9ede046c-307f-42ef-a835-61813331d3a8 tempest-QuotaClassesAdmin257Test-1664438236 tempest-QuotaClassesAdmin257Test-1664438236-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.838009 Nov 02 12:37:59.667207 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 397/764] 10.222.0.64 () {62 vars in 1247 bytes} [Wed Nov 2 12:37:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:37:59.676148 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:59.684611 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:59.698561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.699329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.701163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.705402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.706118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.706723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.727452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:59.938211 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-870ba6d7-3ca9-423f-910e-9fdcf1fc00fc tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.529684 Nov 02 12:37:59.938820 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 368/765] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:37:58 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:59.967662 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:59.985157 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b58c0a13-c0b1-4152-a96a-15013550e2ef tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1270 microversion: 2.1 time: 0.316709 Nov 02 12:37:59.991141 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 398/766] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:59 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1270 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:00.024341 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:00.025367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:00.045514 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.050806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.054191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.056112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.056636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.057077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.196903 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-62c06fc8-f1d3-408b-8fbc-e9d22d3b1819 tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] Calling method '.version_select at 0x7eff5c976700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:00.229429 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-62c06fc8-f1d3-408b-8fbc-e9d22d3b1819 tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.284106 Nov 02 12:38:00.234318 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 369/767] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:37:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:00.245816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-165183ce-3909-4bda-822d-676c7290d709 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c838ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:00.628618 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-165183ce-3909-4bda-822d-676c7290d709 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/a4345a20-f46a-46a0-b066-b453b6dcbb42" status: 200 len: 663 microversion: 2.1 time: 0.391030 Nov 02 12:38:00.629766 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 370/768] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:38:00 2022] GET /compute/v2.1/os-security-groups/a4345a20-f46a-46a0-b066-b453b6dcbb42 => generated 663 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:00.636069 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b3d5e807-ac09-4daf-98bb-bee7635d8daa tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] Action: 'update', calling method: .version_select at 0x7eff5ca68940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:00.657489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:00.705459 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2ed17c50-f7bf-4b2b-a3ec-54e57c9894ea tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1470 microversion: 2.1 time: 0.660555 Nov 02 12:38:00.705459 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 399/769] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:00 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1470 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:00.705459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-406a8525-3cd8-49a9-a198-096895ab8530 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c6963a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.680304 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-406a8525-3cd8-49a9-a198-096895ab8530 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-group-rules/2f548473-c1b0-4452-877c-e4674d92cd5a" status: 202 len: 0 microversion: 2.1 time: 1.010562 Nov 02 12:38:01.681302 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 400/770] 10.222.0.64 () {58 vars in 1287 bytes} [Wed Nov 2 12:38:00 2022] DELETE /compute/v2.1/os-security-group-rules/2f548473-c1b0-4452-877c-e4674d92cd5a => generated 0 bytes in 1012 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:01.690455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.692195 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:01.702540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.703201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.703709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.705197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.705729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.707083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.868555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:01.912372 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8293be78-b70e-4add-8506-0229da2da285 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1276 microversion: 2.1 time: 0.229513 Nov 02 12:38:01.913419 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 401/771] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1276 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:01.918627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdedb786-7c48-47e9-aa18-220972e9405e", "name": "network-vif-deleted", "tag": "a911b949-15e2-47ba-aea9-5c8e8118311c"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:01.948639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.951996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.952565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.972468 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] Creating event network-vif-deleted:a911b949-15e2-47ba-aea9-5c8e8118311c for instance fdedb786-7c48-47e9-aa18-220972e9405e on n-h2-857339-6 Nov 02 12:38:01.981108 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-4b50eb2e-46d2-4f60-b18e-fcd45eb05df5 req-ebc71fe4-9626-4449-8873-5ee84c309481 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066142 Nov 02 12:38:01.983975 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 402/772] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:01.999530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=15,nova_api:UPDATE=16 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:02.004556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f8adecf5-0efc-498d-a38b-f0ceef70af25 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c696670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:02.690885 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f8adecf5-0efc-498d-a38b-f0ceef70af25 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/a4345a20-f46a-46a0-b066-b453b6dcbb42" status: 202 len: 0 microversion: 2.1 time: 0.702987 Nov 02 12:38:02.691418 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 403/773] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:01 2022] DELETE /compute/v2.1/os-security-groups/a4345a20-f46a-46a0-b066-b453b6dcbb42 => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:02.697685 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:02.698452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:02.716213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.716213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.716213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:02.721134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.721656 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.722107 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:02.796797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.797294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.797727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:02.802812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lazy-loading 'fault' on Instance uuid fdedb786-7c48-47e9-aa18-220972e9405e {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:02.974962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:02.983122 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-217bf39a-84c7-491d-ac13-a4826578c5f7 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 200 len: 1304 microversion: 2.1 time: 0.290118 Nov 02 12:38:02.983728 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 404/774] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:02 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 1304 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:03.000865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5cd040d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:03.098294 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b3d5e807-ac09-4daf-98bb-bee7635d8daa tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 2.467020 Nov 02 12:38:03.101738 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 371/775] 10.222.0.64 () {60 vars in 1206 bytes} [Wed Nov 2 12:38:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 2471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:03.119759 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:03.124528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:03.139997 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:03.140783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Neutron security group 541e02e1-4534-4802-851c-5d4ba860c004 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:38:03.141326 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] HTTP exception thrown: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.141326 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Request method failure captured: Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-security-groups/541e02e1-4534-4802-851c-5d4ba860c004 HTTP/1.1 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmSSujFtyMd5rrpycOSSQOWeZuBGx9qn3NoC6-sEjwLpQ0AuwrtlvLN3KRqOst09K5hwpmyhDbX2MwHYl5gRXfA-9y89eM1-z1MgpREVUaEyemeR2VGf1rpKeh_zGiKWkiPDmg9Kr1YdV191HJVBjAorcG6jEuAfuHQk_0hkF23zOiU Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 892fb03c420b40bca466510fca720571 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-399538611 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_892fb03c420b40bca466510fca720571", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/892fb03c420b40bca466510fca720571"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/892fb03c420b40bca466510fca720571"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/892fb03c420b40bca466510fca720571"}]}] Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesTestJSON-399538611 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 892fb03c420b40bca466510fca720571 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-399538611 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesTestJSON-399538611-project Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: fa2b6dc15a41463d86d252948b613f48 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesTestJSON-399538611-project Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '541e02e1-4534-4802-851c-5d4ba860c004'} Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:03.144717 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Returning 404 to user: Security group 541e02e1-4534-4802-851c-5d4ba860c004 does not exist Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-61605971-adda-43bb-8ce7-39d902ad32f4'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:03.149147 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dc80f535-9d7a-4c53-b860-e17765257eca tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/541e02e1-4534-4802-851c-5d4ba860c004" status: 404 len: 194 microversion: 2.1 time: 0.161715 Nov 02 12:38:03.153087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:03.153453 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 405/776] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:02 2022] DELETE /compute/v2.1/os-security-groups/541e02e1-4534-4802-851c-5d4ba860c004 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:03.153626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:03.153790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:03.155103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:03.155978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:03.158287 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6370e5e4-f0d6-4219-8061-c96a0f1e06c1 tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] Calling method '.version_select at 0x7eff5c7af040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:03.164908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:03.220113 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6370e5e4-f0d6-4219-8061-c96a0f1e06c1 tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.066043 Nov 02 12:38:03.223196 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 406/777] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 12:38:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:03.243096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9b1b0ede-6c55-4852-91a7-6879d648dab6 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c7afe50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:04.109774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:04.125106 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-17c81850-4480-4a5d-b2ee-24e6d42cd714 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 1.020974 Nov 02 12:38:04.126417 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 372/778] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:03 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:04.138431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54217e42-6e0f-4e7c-9d23-f905607893ff tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c9764c0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:04.598385 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9b1b0ede-6c55-4852-91a7-6879d648dab6 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/a8d55670-b40a-4977-b74b-2e9b87abc207" status: 202 len: 0 microversion: 2.1 time: 1.358275 Nov 02 12:38:04.598385 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 407/779] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:03 2022] DELETE /compute/v2.1/os-security-groups/a8d55670-b40a-4977-b74b-2e9b87abc207 => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:04.610814 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:04.622601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: fdedb786-7c48-47e9-aa18-220972e9405e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:04.638743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.641681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.642224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.643997 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:04.647052 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:04.648035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:04.685290 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] HTTP exception thrown: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Request method failure captured: Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e HTTP/1.1 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQNPiGqcjl6ebjtJ9LekmY4S6J-5YIZun-o5Y5yNpPOWarm5vNwgxWKjNtec8PtnSLcgvtOtybGGhBdKa-Aij5VBKQTuWc730z4BFQ8MYS0UKULi3AfWaRwNV_Gvjg-ggAhMmuOecavPj7nV9Eouz5vZT9MItwajxFOkfrvZH5c0_s Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e09079e89384417879f678c0a4df5c2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}] Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a0475d03f0e14972a733ba9db2d32947 Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'fdedb786-7c48-47e9-aa18-220972e9405e'} Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:04.687593 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:04.692742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Returning 404 to user: Instance fdedb786-7c48-47e9-aa18-220972e9405e could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:04.694246 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-79d5179b-0734-4f59-83c4-99fe0a69110c tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e" status: 404 len: 111 microversion: 2.1 time: 0.098966 Nov 02 12:38:04.694246 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 408/780] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:04 2022] GET /compute/v2.1/servers/fdedb786-7c48-47e9-aa18-220972e9405e => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:04.708975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9f569455-0ea2-4b20-830a-a8a22e5be83e tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c915a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:05.581834 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9f569455-0ea2-4b20-830a-a8a22e5be83e tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/511f9c7b-ed8b-41e1-8c44-eb0c1f436ce2" status: 202 len: 0 microversion: 2.1 time: 0.886633 Nov 02 12:38:05.584131 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 409/781] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:04 2022] DELETE /compute/v2.1/os-security-groups/511f9c7b-ed8b-41e1-8c44-eb0c1f436ce2 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:05.591488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:05.597640 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:05.607756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:05.607756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:05.607756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:05.617911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:05.618676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:05.620327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:05.683028 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:06.241076 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-54217e42-6e0f-4e7c-9d23-f905607893ff tempest-QuotaClassesAdminTestJSON-1174352094 tempest-QuotaClassesAdminTestJSON-1174352094-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 2.112068 Nov 02 12:38:06.243379 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 373/782] 10.222.0.64 () {60 vars in 1206 bytes} [Wed Nov 2 12:38:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:06.248123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:06.249378 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:06.256977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.257520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.258028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.258856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.259243 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.259733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.299774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:06.423054 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-633bd9f5-91fe-44bc-96a4-9e4bd6ccb886 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "DELETE /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 204 len: 0 microversion: 2.1 time: 0.836602 Nov 02 12:38:06.426768 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 410/783] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:05 2022] DELETE /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:06.440831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a21e9017-90d1-48b7-8e73-de83cf8c38cb tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c790790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:06.494496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:06.522235 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-18344867-6f60-4da7-b8bf-680ae04c1831 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.270617 Nov 02 12:38:06.523188 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 374/784] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:06 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:06.534522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:06.538920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:06.553961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.555233 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.555935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.556941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:06.557820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:06.558474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:06.943135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:06.957703 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-33bcc82e-3bcd-40ef-9a2b-632841c09280 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1468 microversion: 2.1 time: 0.433204 Nov 02 12:38:06.972926 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 375/785] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:06 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:06.991228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d3b83d3-e6c6-41ae-bbe9-956b72518a4c", "tag": "fcc539fb-7746-43f8-9cae-cd39a75ae229"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:07.013172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:07.013935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:07.014414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:07.034424 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] Creating event network-changed:fcc539fb-7746-43f8-9cae-cd39a75ae229 for instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c on n-h1-857339-6 Nov 02 12:38:07.049446 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-eca2b1bb-d8df-450f-8ad6-6bc92e67074c req-dcc31047-15b8-4ea1-9e3b-310571791eef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074903 Nov 02 12:38:07.050400 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 376/786] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:07.217852 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a21e9017-90d1-48b7-8e73-de83cf8c38cb tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/0cfda707-a744-4f65-8266-399a555c5e8a" status: 202 len: 0 microversion: 2.1 time: 0.786318 Nov 02 12:38:07.218893 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 411/787] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:06 2022] DELETE /compute/v2.1/os-security-groups/0cfda707-a744-4f65-8266-399a555c5e8a => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:07.230700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ecf3e4f-cb3a-4c62-af3b-488e77ad5ba8 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5ce47280>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:07.547418 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:07.548195 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:07.566572 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:07.567081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:07.567543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:07.568303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:07.572087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:07.572624 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:07.807091 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6ecf3e4f-cb3a-4c62-af3b-488e77ad5ba8 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/74a2e67b-ed65-4c3c-bd0b-8ce87232214d" status: 202 len: 0 microversion: 2.1 time: 0.584108 Nov 02 12:38:07.808908 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 377/788] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:07 2022] DELETE /compute/v2.1/os-security-groups/74a2e67b-ed65-4c3c-bd0b-8ce87232214d => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:07.997819 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:08.017404 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e8015c55-9081-4355-a0e8-b738d1894061 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.474621 Nov 02 12:38:08.032866 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 412/789] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:07 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:08.050528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-047d3582-2577-4f71-82d6-42f6452f6320 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] Calling method '.version_select at 0x7eff5c915700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:08.127334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1046635", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "a54ad5a3-ab70-4409-86c2-06a8fb1fa53e"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:08.206289 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] validate_networks() for [('a54ad5a3-ab70-4409-86c2-06a8fb1fa53e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4161a88-74c7-4eef-b952-73db9a508874) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:08.806401 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4161a88-74c7-4eef-b952-73db9a508874) Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] Request method failure captured: Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 221 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmSvmmFLQ_dzx8NEXsgl27oTP3wCZaKwVS15zal7vAsWuErZI48elYwvCt12dniXTyJ24wG_8pJar5oKoKvs35UTm-tqr45eFKipiODQYFKMOgejmpbpL2oVyklBbnX-HxWB2OesboG2sT0FErYA7G0c7Wm9p_oSd7htJqew5WjMaV8 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: b2834f9f8817473da8d55cb6420739da Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b2834f9f8817473da8d55cb6420739da", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2834f9f8817473da8d55cb6420739da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b2834f9f8817473da8d55cb6420739da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2834f9f8817473da8d55cb6420739da"}]}] Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: b2834f9f8817473da8d55cb6420739da Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 211b46d089c04fa9a25fd61a1f95049d Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1046635", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "a54ad5a3-ab70-4409-86c2-06a8fb1fa53e"}]}} Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:08.810575 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationNegativeTestJSON-server-1046635', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'a54ad5a3-ab70-4409-86c2-06a8fb1fa53e'}]}}} Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:08.814063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b4161a88-74c7-4eef-b952-73db9a508874) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6749f516-851f-475f-875c-3fdc4e198762 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857 tempest-FloatingIPsAssociationNegativeTestJSON-2093495857-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.000205 Nov 02 12:38:08.821599 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 378/790] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 1006 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:08.827388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:08.829749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:08.853265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.853265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.853265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.855115 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:08.855601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:08.856085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:08.998603 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-047d3582-2577-4f71-82d6-42f6452f6320 tempest-SecurityGroupRulesTestJSON-399538611 tempest-SecurityGroupRulesTestJSON-399538611-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/21d0808e-ecbe-4e46-b64f-a86195cf7ea3" status: 202 len: 0 microversion: 2.1 time: 0.964016 Nov 02 12:38:09.003152 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 413/791] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:08 2022] DELETE /compute/v2.1/os-security-groups/21d0808e-ecbe-4e46-b64f-a86195cf7ea3 => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:09.079036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:09.079771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:09.090836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.097763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.098733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:09.099759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:09.100558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:09.102327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:09.692969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:09.739201 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f79b096c-5a41-4d07-a4af-9ae27f288551 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.677619 Nov 02 12:38:09.743033 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 414/792] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:09 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:09.948743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2004017862", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:09.975272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=9 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:10.057137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:10.082610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:10.113038 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a17c0b9a-d2d8-4bf9-84c8-a70bbcacb350 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1468 microversion: 2.1 time: 1.295172 Nov 02 12:38:10.137509 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 379/793] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:08 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1468 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:10.449108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:10.450439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:10.452012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:10.452844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:10.453638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:10.477981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.478774 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.479863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.481033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.481958 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.486267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.509846 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d0ddc9-7d7b-463a-9055-b118b37d85c1", "name": "network-vif-deleted", "tag": "8151f4b5-7a32-4062-8f54-70ba3968340d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:10.535806 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.536287 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.540253 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.543435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Getting quotas for project 4eca4631088f4e8e9b23c9070680dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:10.560693 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Getting quotas for user ddec067445d54223aa49c8a5ec9dea6b and project 4eca4631088f4e8e9b23c9070680dbee. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:10.563255 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] Creating event network-vif-deleted:8151f4b5-7a32-4062-8f54-70ba3968340d for instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 on n-h1-857339-6 Nov 02 12:38:10.570939 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-885d0c54-5910-4a9a-aff2-e6a376cca743 req-6a949643-e832-42fe-a02b-ba69aa11f334 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065192 Nov 02 12:38:10.572163 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 380/794] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:10.576590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:10.579759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:10.772310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:10.773284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:10.782511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.783420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.783967 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.785095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:10.785746 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:10.786853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:10.849198 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-30efd9fa-b665-490c-bbfa-21741ac85361 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104203 Nov 02 12:38:10.850154 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 415/795] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:10.864055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c0e80eb0-66be-4050-a070-768af272d3d5 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:10.865618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c0e80eb0-66be-4050-a070-768af272d3d5 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:11.183776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c0e80eb0-66be-4050-a070-768af272d3d5 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.197198 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c0e80eb0-66be-4050-a070-768af272d3d5 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1223 microversion: 2.1 time: 0.339282 Nov 02 12:38:11.199897 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 416/796] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:10 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1223 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:11.210122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:11.211512 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:11.232720 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:11.233244 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:11.233738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:11.234505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:11.235005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:11.235429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:11.421857 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.435061 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bc430667-d309-426b-a8c5-d1184aad866b tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1298 microversion: 2.1 time: 0.234059 Nov 02 12:38:11.435687 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 417/797] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:11 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:11.497451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:11.525904 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1f6523d0-8d04-41d5-aa1a-4eb69c32e52c tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.760257 Nov 02 12:38:11.527207 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 381/798] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:10 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:12.226834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cea5e03c-dc34-4d4e-a93e-18b06ac89d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.227590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cea5e03c-dc34-4d4e-a93e-18b06ac89d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.396477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cea5e03c-dc34-4d4e-a93e-18b06ac89d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:12.406266 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cea5e03c-dc34-4d4e-a93e-18b06ac89d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1223 microversion: 2.1 time: 0.184246 Nov 02 12:38:12.409166 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 418/799] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:12 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1223 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:12.464778 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.465464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.481028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.482026 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.482656 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.490530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.491291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.491888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.573076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.594405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:12.595884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:12.604815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.608168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.608921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lazy-loading 'fault' on Instance uuid 63d0ddc9-7d7b-463a-9055-b118b37d85c1 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:12.610792 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.618518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.619147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.621087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:12.627985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:12.628773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:12.785065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0475d03f0e14972a733ba9db2d32947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e09079e89384417879f678c0a4df5c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:12.808155 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b062958-0006-4100-bf20-5ff46eb3c801 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 200 len: 1303 microversion: 2.1 time: 0.350281 Nov 02 12:38:12.808874 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 382/800] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:12 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 1303 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:13.018108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:13.034906 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-745f9e6b-12ac-487a-8d75-f39f1c98aeb4 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.452978 Nov 02 12:38:13.040464 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 419/801] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:12 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:13.438385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:13.439308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:13.458802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.458802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.458802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.458802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.458802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.459188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.699960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:13.716273 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4bbdbde3-f636-4c39-ab93-a57bb76ab8ec tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1227 microversion: 2.1 time: 0.282206 Nov 02 12:38:13.717122 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 383/802] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:13 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:13.845561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:13.846993 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] [instance: 63d0ddc9-7d7b-463a-9055-b118b37d85c1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:13.861788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.863100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.866927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.867964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:13.869825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:13.870860 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:13.902329 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] HTTP exception thrown: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Request method failure captured: Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 HTTP/1.1 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmQNPiGqcjl6ebjtJ9LekmY4S6J-5YIZun-o5Y5yNpPOWarm5vNwgxWKjNtec8PtnSLcgvtOtybGGhBdKa-Aij5VBKQTuWc730z4BFQ8MYS0UKULi3AfWaRwNV_Gvjg-ggAhMmuOecavPj7nV9Eouz5vZT9MItwajxFOkfrvZH5c0_s Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e09079e89384417879f678c0a4df5c2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e09079e89384417879f678c0a4df5c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e09079e89384417879f678c0a4df5c2"}]}] Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6e09079e89384417879f678c0a4df5c2 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminTestJSON-1488127799 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a0475d03f0e14972a733ba9db2d32947 Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminTestJSON-1488127799-project Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '63d0ddc9-7d7b-463a-9055-b118b37d85c1'} Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:13.904627 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. Nov 02 12:38:13.908679 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:13.912033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] Returning 404 to user: Instance 63d0ddc9-7d7b-463a-9055-b118b37d85c1 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:13.913518 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f3e35614-618a-42dd-a760-2b25c0a47c03 tempest-ServersAdminTestJSON-1488127799 tempest-ServersAdminTestJSON-1488127799-project] 10.222.0.64 "GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1" status: 404 len: 111 microversion: 2.1 time: 0.083560 Nov 02 12:38:13.915270 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 420/803] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:13 2022] GET /compute/v2.1/servers/63d0ddc9-7d7b-463a-9055-b118b37d85c1 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:14.067013 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:14.068543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:14.086943 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.087453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.088075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.088974 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.089486 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.089914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.276047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:14.285834 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0f2f2667-93f7-48cb-8a53-930237a204f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.224037 Nov 02 12:38:14.287279 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 384/804] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:14 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:14.745258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:14.747776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:14.774352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.776336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.778859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.780912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:14.783496 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:14.788373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:14.984202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:15.011088 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c57bf603-c953-4f3a-bdf8-5147e276d659 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1275 microversion: 2.1 time: 0.272996 Nov 02 12:38:15.012131 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 421/805] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:14 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:15.314346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:15.315638 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:15.330071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.330912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.331508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:15.336915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:15.341637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:15.342337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.043810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:16.045388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:16.064540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.067174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.067174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.067174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:16.068211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:16.068930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:16.241003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=56,nova_cell0:UPDATE=14 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:16.262104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:16.277431 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c16a7d7-d286-44d7-8bbc-f3bafc41e50d tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1293 microversion: 2.1 time: 0.232242 Nov 02 12:38:16.279196 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 422/806] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:16 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1293 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:16.297841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:16.314777 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8b8b1386-1dfa-4fa8-8cbd-5229b21da805 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 1.003165 Nov 02 12:38:16.316261 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 385/807] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:15 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.313484 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:17.314110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:17.322944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.329459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.329459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.329459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.329459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.329459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.347567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:17.348571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:17.373657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.374640 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.375367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.376676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.378203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.381097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.482949 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:17.535571 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5d7c356c-8732-4735-85d2-4d52d3a7cf88 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1281 microversion: 2.1 time: 0.190205 Nov 02 12:38:17.535571 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 423/808] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:17 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1281 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.584613 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3b83d3-e6c6-41ae-bbe9-956b72518a4c", "name": "network-vif-plugged", "status": "completed", "tag": "fcc539fb-7746-43f8-9cae-cd39a75ae229"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:17.618912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:17.619718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:17.620541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:17.632822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:17.643341 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] Creating event network-vif-plugged:fcc539fb-7746-43f8-9cae-cd39a75ae229 for instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c on n-h1-857339-6 Nov 02 12:38:17.646243 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-68196a69-6da8-423c-9e01-d8c21cfe34e8 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.304068 Nov 02 12:38:17.647846 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 386/809] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:17 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:17.663695 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-26cf588a-0aee-4353-aabd-672622717ab5 req-1cb7f98e-0116-488a-8e72-29958921c263 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083495 Nov 02 12:38:17.664596 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 424/810] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:18.058482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1940128409", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}], "block_device_mapping_v2": [{"uuid": "ab3cf6e6-8379-4ab6-a065-54d642687076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:18.205588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] validate_networks() for [('23e0a14b-01ee-4bd0-a40e-13696a902666', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:18.528442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:18.532883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:18.543656 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.545312 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.546775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:18.548161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:18.548975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:18.556426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.016174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.024250 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a3db66a8-6a28-4db2-9b97-51431579bffb tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.501028 Nov 02 12:38:19.028735 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 425/811] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:18 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:19.030362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.030983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:19.037450 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.037946 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.038385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.039091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:19.039724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:19.040157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:19.044829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:19.145428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e) Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Request method failure captured: Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 349 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmRhwz1DjCngl1_cW3AvKfunK_rZdYh3CxOZj_hS59fc4gSqLCemRilmUfcW0MfkIMkgFfFdgaqByiX0b655hQwe2c8HmCMZ6UYQFjJPPpQwru1MbNeih8IruptjqUltJVK5EqLWQXkpZ6NmsBGDe1ZnpN6BzfHpc33T9W8hvTQkYqc Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_57ab8b7723184d3e9eff5809eafffb20", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/57ab8b7723184d3e9eff5809eafffb20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/57ab8b7723184d3e9eff5809eafffb20"}]}] Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveMigrationTest-1779573083 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 57ab8b7723184d3e9eff5809eafffb20 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveMigrationTest-1779573083 Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveMigrationTest-1779573083-project Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 9379cc116a1e4896b7df09dcfa75eb4f Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveMigrationTest-1779573083-project Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-LiveMigrationTest-server-1940128409", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "23e0a14b-01ee-4bd0-a40e-13696a902666"}], "block_device_mapping_v2": [{"uuid": "ab3cf6e6-8379-4ab6-a065-54d642687076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:19.150474 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-LiveMigrationTest-server-1940128409', 'imageRef': '', 'flavorRef': '452', 'networks': [{'uuid': '23e0a14b-01ee-4bd0-a40e-13696a902666'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'ab3cf6e6-8379-4ab6-a065-54d642687076'}]}}} Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:19.167478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-21e78485-b8bd-4e0e-8c6b-1991f33b9e0e) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d455da59-bd18-4a8b-9a8e-63e0f81c1582 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.099256 Nov 02 12:38:19.176303 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 387/812] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:18 2022] POST /compute/v2.1/servers => generated 214 bytes in 1100 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:19.183939 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dc506afe-971a-475f-a709-9f12ea319952 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] Calling method '.version_select at 0x7eff5c838700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:19.287077 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dc506afe-971a-475f-a709-9f12ea319952 tempest-LiveMigrationTest-1779573083 tempest-LiveMigrationTest-1779573083-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-957997551" status: 202 len: 0 microversion: 2.1 time: 0.118248 Nov 02 12:38:19.295325 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 388/813] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:38:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-957997551 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:19.470457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:19.500339 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b3e35ca0-a9d3-49cd-90e2-645a0b5c1bf5 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1318 microversion: 2.1 time: 0.473276 Nov 02 12:38:19.505874 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 426/814] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:20.047614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.048201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.056323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.057089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.057829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.058755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.059381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.060000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.202690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2a0fdd3f-06a4-475e-bf03-df948343fcbf tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5cf693a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.406676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:20.415024 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-047cbf55-8455-4fb1-8f85-e5ad0524347f tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.371641 Nov 02 12:38:20.415712 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 427/815] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:20 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:20.543915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:20.545361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.554474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:20.556731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.557488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.558082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.559032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.560035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.560688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.823902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:20.852323 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-009a10d2-3887-4f95-b1fa-d08f7e0c53f3 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1468 microversion: 2.1 time: 0.316839 Nov 02 12:38:20.854815 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 428/816] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:20 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1468 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:20.904178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:20.905498 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:20.929069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.031707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lazy-loading 'flavor' on Instance uuid 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:21.408586 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2a0fdd3f-06a4-475e-bf03-df948343fcbf tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb" status: 200 len: 371 microversion: 2.1 time: 1.742285 Nov 02 12:38:21.408586 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 389/817] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:38:19 2022] GET /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb => generated 371 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:21.419948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1f3d0af-668e-4219-8242-5c211c9ede0e", "tag": "433f6a59-c965-48e7-a9d7-ddab10cd09d0"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:21.443567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:21.443975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:21.444431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:21.467367 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] Creating event network-changed:433f6a59-c965-48e7-a9d7-ddab10cd09d0 for instance b1f3d0af-668e-4219-8242-5c211c9ede0e on n-h2-857339-6 Nov 02 12:38:21.472806 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-2b96c895-3d15-4ebb-b39a-fabfb0a5f7da req-dfe76c08-c897-4215-8ce0-ddfcb8ba3482 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066013 Nov 02 12:38:21.493403 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 390/818] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:21.544269 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-08fd489c-7fb9-4123-b1f1-bdd917ff8f36 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c/action" status: 202 len: 0 microversion: 2.1 time: 0.648674 Nov 02 12:38:21.547036 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 429/819] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:38:20 2022] POST /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:21.563729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c694940>, body: {"quota_set": {"ram": "5120"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:22.287425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.294436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.295048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.296414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.297359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.298599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.299114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.338771 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-22aa97e6-cdd9-4c3b-a893-a93803be7c2a tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.863326 Nov 02 12:38:22.340022 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 391/820] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:38:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:22.345191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.346023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.355951 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.357145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.359066 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.361128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.361720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.362171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.399269 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=20 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:22.520643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.521236 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.521621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.522438 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.527900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.528361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.644431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:22.654724 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4a44483f-49bb-44f4-9486-46120bb79f42 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.313448 Nov 02 12:38:22.655324 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 392/821] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:22.673116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.677877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:22.688005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.688557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.688993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.701889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.702842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.703450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.728738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:22.786631 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37068144-1f4b-4b71-b8ba-665c32abbdf1 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb" status: 200 len: 328 microversion: 2.1 time: 1.239386 Nov 02 12:38:22.794294 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 430/822] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:38:21 2022] PUT /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb => generated 328 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:22.799826 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.813807 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.814696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.819672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.822992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.825473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.827564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.886721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:22.895935 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-230bc039-8fea-49ec-b35d-8dd6a33a135f tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?host=n-d-857339-6" status: 200 len: 578 microversion: 2.1 time: 0.099838 Nov 02 12:38:22.899412 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 431/823] 10.222.0.64 () {58 vars in 1172 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/os-services?host=n-d-857339-6 => generated 578 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:22.900880 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-65fbf44c-eee6-418f-a0ab-d5c9226b43f1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1459 microversion: 2.1 time: 0.241172 Nov 02 12:38:22.903592 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 393/824] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1459 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:22.908695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a6a72761-acd0-4729-ae47-c51de52ff8a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.938420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.943812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.945326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.945762 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.946501 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:22.947059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:22.947405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:22.985214 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aebbb79c-cd26-492b-a7e2-8c05e9743a59 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.050752 Nov 02 12:38:22.985405 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 394/825] 10.222.0.64 () {58 vars in 1176 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:22.990571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:22.992561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.015425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.015926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.016361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.017291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.017915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.018540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.032382 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a6a72761-acd0-4729-ae47-c51de52ff8a4 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb" status: 202 len: 0 microversion: 2.1 time: 0.131844 Nov 02 12:38:23.033452 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 432/826] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:38:22 2022] DELETE /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:23.042983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.044521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.045139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.045587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.046339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.046801 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.055787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.125804 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c9df1ed7-9edc-4c61-8ff8-cd15608b36d3 tempest-ServicesAdminTestJSON-975715139 tempest-ServicesAdminTestJSON-975715139-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.091312 Nov 02 12:38:23.126925 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 433/827] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:23.140592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-da70bb74-a786-4086-8529-70e2eb07e23e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5c9154c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.887746 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-da70bb74-a786-4086-8529-70e2eb07e23e tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb" status: 200 len: 371 microversion: 2.1 time: 0.757569 Nov 02 12:38:23.893003 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 434/828] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/os-quota-sets/b511d2a2d3664660a8fcc8720322a0bb => generated 371 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:23.908094 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:23.911789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:23.925246 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.926428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.927825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:23.928886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:23.929601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:23.931135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.337427 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c3c104e1-6f64-4903-a5dd-59fd33dd2220 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1610 microversion: 2.1 time: 1.350803 Nov 02 12:38:24.340977 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 395/829] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:22 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1610 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.367287 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.371415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.371923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.372365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.376232 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.379336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.380590 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.448153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=16,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:24.457261 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-30bfc12b-7e25-45af-9bf1-ab3f51967229 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.094968 Nov 02 12:38:24.458228 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 396/830] 10.222.0.64 () {58 vars in 1176 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:24.477324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-857339-6", "block_migration": true, "disk_over_commit": false}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:24.481000 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.487494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.489994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.489994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.490209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.490810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.491246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.535484 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:24.546374 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d5e2177-6693-4983-add5-3f74869d7c40 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.651044 Nov 02 12:38:24.550862 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 435/831] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:23 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:24.812658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-024dc8a5-dcfa-4471-8fb5-ad731f8a1e6d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5c915a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0e7e7ebf-7f82-433a-937c-b99dd399755a) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:24.946172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0e7e7ebf-7f82-433a-937c-b99dd399755a) Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Request method failure captured: Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c/action HTTP/1.1 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 97 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR7SAqqvX6EiIiFa9xSOvp8YFc2thufeCq8Djml880ljwBO0FoFWRv6iBkkhU59uPyqQVemBuI-qk78EjBCxLWUnutya5LT4lhkH1eMDWqGHEhAsNvWaoeokXCYzkfl6UyMmJl8_oamAm8nz_YYXX9zG-qPK0J7LcIwscgY35z9It4 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f6d4fa85f0fc497f96bf3533a0b98c1f Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6d4fa85f0fc497f96bf3533a0b98c1f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6d4fa85f0fc497f96bf3533a0b98c1f"}]}] Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f6d4fa85f0fc497f96bf3533a0b98c1f Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1943197550 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveMigrationNegativeTest-1943197550-project-admin Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8f7ae91cc1a34bfcab5a04fd57e8a2c2 Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveMigrationNegativeTest-1943197550-project-admin Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: {"os-migrateLive": {"host": "n-h2-857339-6", "block_migration": true, "disk_over_commit": false}} Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '6d3b83d3-e6c6-41ae-bbe9-956b72518a4c', 'body': {'os-migrateLive': {'host': 'n-h2-857339-6', 'block_migration': True, 'disk_over_commit': False}}} Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:24.950271 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:24.954040 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0e7e7ebf-7f82-433a-937c-b99dd399755a) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-994e36b5-64a3-472f-bd3b-973c6bcd3416 tempest-LiveMigrationNegativeTest-1943197550 tempest-LiveMigrationNegativeTest-1943197550-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c/action" status: 500 len: 214 microversion: 2.1 time: 0.479882 Nov 02 12:38:24.959301 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 397/832] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:38:24 2022] POST /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c/action => generated 214 bytes in 482 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 12:38:24.966157 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:24.970978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:24.979198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.979709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.982845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:24.983687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:24.984173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:24.987254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.047541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:25.356610 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-024dc8a5-dcfa-4471-8fb5-ad731f8a1e6d tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca/defaults" status: 200 len: 371 microversion: 2.1 time: 0.547985 Nov 02 12:38:25.358905 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 436/833] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:38:24 2022] GET /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca/defaults => generated 371 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:25.530267 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1e79cd53-b749-419c-b868-26c8b10df9e6 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 204 len: 0 microversion: 2.1 time: 0.568501 Nov 02 12:38:25.531900 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 398/834] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:24 2022] DELETE /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:25.563951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:25.566628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:25.586102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.586858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.596144 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.600641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:25.602116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:25.604346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:25.860677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-895094307", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:25.957277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:26.099472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.112873 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9aaaa7bd-2349-42f9-9268-9ca457acfbc0 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1465 microversion: 2.1 time: 0.572849 Nov 02 12:38:26.113496 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 437/835] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:25 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1465 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.118455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.119062 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.125164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.125865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.126302 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.127098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.127561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.127981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.416058 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:26.416502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:26.416981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:26.417429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:26.423585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:26.442321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.443098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.443611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.450424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.451041 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.459044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.459363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.464884 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-84e16bc4-6437-498f-97ab-4d7fa8d27d7b tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.349910 Nov 02 12:38:26.466045 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 438/836] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:26.470924 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f3d0af-668e-4219-8242-5c211c9ede0e", "name": "network-vif-plugged", "status": "completed", "tag": "433f6a59-c965-48e7-a9d7-ddab10cd09d0"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:26.481704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:26.482522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:26.483138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:26.500958 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] Creating event network-vif-plugged:433f6a59-c965-48e7-a9d7-ddab10cd09d0 for instance b1f3d0af-668e-4219-8242-5c211c9ede0e on n-h2-857339-6 Nov 02 12:38:26.522613 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-3e41563a-4f39-453c-9b79-406a5262fa11 req-4b6d019b-01d0-493e-9fd9-46405bf619ad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046049 Nov 02 12:38:26.522613 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 439/837] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:26.522864 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Getting quotas for project 607346d5cd14420f930647ff1ecdb94d. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:26.540203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Getting quotas for user 63589f909a744bf1afec7d1f2e659f8a and project 607346d5cd14420f930647ff1ecdb94d. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:26.557760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:26.560111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6cf3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:26.562150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:26.782440 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f50bdd7a-567b-4144-9415-851090a1989d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211642 Nov 02 12:38:26.784229 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 399/838] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:26.798118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bf0ff247-2768-496e-aa27-4a41f71139f7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:26.801583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bf0ff247-2768-496e-aa27-4a41f71139f7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:26.951967 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bf0ff247-2768-496e-aa27-4a41f71139f7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:26.963487 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bf0ff247-2768-496e-aa27-4a41f71139f7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1216 microversion: 2.1 time: 0.172921 Nov 02 12:38:26.965562 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 400/839] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:26 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1216 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:27.175042 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.178739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.179719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.182700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.183319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.185030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.352070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-685240510", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:27.444686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:27.451512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:27.451512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:27.451512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:27.451512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:27.462984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.463536 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.463973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.464799 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.465282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.465799 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.493481 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Getting quotas for project 4e0aa9b18c154964972a8c57c290dfe0. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:27.516821 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Getting quotas for user ebf0681a98044ce29352cc8abdaa69f1 and project 4e0aa9b18c154964972a8c57c290dfe0. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:27.533565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:27.536600 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:27.650472 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cdb3a653-6923-4ddf-8490-bedc4698e2f5 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678" status: 200 len: 328 microversion: 2.1 time: 1.099403 Nov 02 12:38:27.658372 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 440/840] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:38:26 2022] PUT /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678 => generated 328 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:27.670961 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.671725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:27.689004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:27.697313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.697313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.697313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.697313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.697866 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1fc73cb4-8c48-47cc-b5a1-350dc33b3778 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.712922 Nov 02 12:38:27.698297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.698380 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 401/841] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:38:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:38:27.706491 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.707868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:27.711356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:27.724576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.726588 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.729270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:27.730703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:27.733393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:27.734545 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.144412 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.160475 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-20f36a2f-ad76-4795-8819-bbdf8a32aea6 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1323 microversion: 2.1 time: 0.463681 Nov 02 12:38:28.161044 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 402/842] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.186218 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5c726d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.219391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.234133 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-84ff08ec-f69a-4db4-af40-65ad4aeca640 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1465 microversion: 2.1 time: 0.569434 Nov 02 12:38:28.247140 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 441/843] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:27 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1465 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.247140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.247140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:28.319716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.320193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.323416 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.324399 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.326471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.327930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.388332 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4e4b1d0b-7348-4b83-8c45-ceed2a673c29 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678/detail" status: 200 len: 916 microversion: 2.1 time: 0.212608 Nov 02 12:38:28.390230 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 403/844] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678/detail => generated 916 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:28.404912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a0449f2e-1a8f-44fb-bf49-dc9c2107d20b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:28.420625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a0449f2e-1a8f-44fb-bf49-dc9c2107d20b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:28.677924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a0449f2e-1a8f-44fb-bf49-dc9c2107d20b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.687248 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a0449f2e-1a8f-44fb-bf49-dc9c2107d20b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1216 microversion: 2.1 time: 0.295419 Nov 02 12:38:28.687835 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 404/845] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1216 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:28.738310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.748394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Action: 'update', calling method: .version_select at 0x7eff5ce47a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:28.766861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.768416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:28.800089 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c71fe846-22b2-4c73-9481-acc2f8f81393 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1452 microversion: 2.91 time: 0.563647 Nov 02 12:38:28.808082 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 442/846] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:28 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1452 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:28.829986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d3b83d3-e6c6-41ae-bbe9-956b72518a4c", "name": "network-vif-deleted", "tag": "fcc539fb-7746-43f8-9cae-cd39a75ae229"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:28.849192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.850914 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.852967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.883145 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] Creating event network-vif-deleted:fcc539fb-7746-43f8-9cae-cd39a75ae229 for instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c on n-h1-857339-6 Nov 02 12:38:28.904998 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-80c9c3af-92ac-4619-b33f-d4a29b058053 req-f1d6fc3e-281e-44c1-91ac-b859a34d02ab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095320 Nov 02 12:38:28.905597 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 443/847] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:28.929384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.931515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.931979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:28.932798 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:28.939986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:28.940935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.057852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.058801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.059308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.060248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.060815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.061308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.193781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.195866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.207008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.210067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.211231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.212427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.213122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.214138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.276044 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b4895777-7850-4ce6-8795-e6f89a52d178 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678?user_id=3b7ce8dd3f39456190b984c1f3bcd934" status: 200 len: 328 microversion: 2.1 time: 0.544562 Nov 02 12:38:29.277530 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 405/848] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Nov 2 12:38:28 2022] PUT /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678?user_id=3b7ce8dd3f39456190b984c1f3bcd934 => generated 328 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:29.283062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:29.284006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:29.290990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.294045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.295641 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.296406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.296905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.297333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.344068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:29.344653 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:29.351888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:29.351888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lazy-loading 'fault' on Instance uuid 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:29.805792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:29.815604 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8e4c837c-0079-4017-acbb-26a772550d88 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 200 len: 1308 microversion: 2.1 time: 0.536797 Nov 02 12:38:29.825316 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 406/849] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:29.840171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-83a9f014-2905-48cf-b0f5-6b364725cec7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5d1a20d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.163722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.179743 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eb47d2c7-c48b-4005-bd1d-16ab9488d436 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1472 microversion: 2.1 time: 0.993366 Nov 02 12:38:30.194922 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 444/850] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1472 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.220063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.221323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.237717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.238300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.238894 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.240268 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.242381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.249760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.251774 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-83a9f014-2905-48cf-b0f5-6b364725cec7 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678?user_id=3b7ce8dd3f39456190b984c1f3bcd934" status: 200 len: 370 microversion: 2.1 time: 0.424766 Nov 02 12:38:30.252367 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 407/851] 10.222.0.64 () {58 vars in 1323 bytes} [Wed Nov 2 12:38:29 2022] GET /compute/v2.1/os-quota-sets/a123ecce7cb24da7bf74256dc4847678?user_id=3b7ce8dd3f39456190b984c1f3bcd934 => generated 370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:30.265683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.266426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.279458 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.282137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.284874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.292165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.295753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.296296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.477111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.487596 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-89142e40-7221-4a56-b9cc-f38dba9f5f10 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1268 microversion: 2.1 time: 0.291215 Nov 02 12:38:30.488828 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 445/852] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:30.494471 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.494985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.503797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.506827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.507672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.510292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.515871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.519871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.560751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.575719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.577746 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.601654 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-58c7f559-ae09-49d1-86d5-5d263d05b24d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1456 microversion: 2.91 time: 0.347207 Nov 02 12:38:30.616842 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:30.617647 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 408/853] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1456 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Request method failure captured: Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e/diagnostics HTTP/1.1 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmSu93z0VW6UIOy7FGVYl0_N1inOlUHb2hC9A_4f7LTFU7PZnYhG8w_BU-Wzma3m_jJ2660FrEXoxkEJwU6DYdTHj_nhopT4_9VWxxX-GY9KlQY4ehvyfHZJ_QkJC5kLZgvpPRqkkqNHpfq5VkaOaValcbdzvh1ys8wEH7KAlLjyCT8 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 4eca4631088f4e8e9b23c9070680dbee Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4eca4631088f4e8e9b23c9070680dbee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4eca4631088f4e8e9b23c9070680dbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4eca4631088f4e8e9b23c9070680dbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4eca4631088f4e8e9b23c9070680dbee"}]}] Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 4eca4631088f4e8e9b23c9070680dbee Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerDiagnosticsNegativeTest-2134958545-project Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: ddec067445d54223aa49c8a5ec9dea6b Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2134958545-project Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'server_id': 'b1f3d0af-668e-4219-8242-5c211c9ede0e'} Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.620453 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-578f95cc-1f97-41e6-ad05-20608c3c1335 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.138479 Nov 02 12:38:30.640578 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 446/854] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e/diagnostics => generated 117 bytes in 141 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:30.644861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.645960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.662382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.669213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.669213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.669213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.669213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.669213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.735903 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:30.849295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.849986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.859780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.860601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.861893 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.871736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.872470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.873128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.907927 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] HTTP exception thrown: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Request method failure captured: Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c HTTP/1.1 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmR69_pIBULD0yYdRkUn6jjClOK_JylsigB--IKYFLLKtgFXJRC0LrTcWq84ecJEbRYk9FVvhNTYrtcc79fIuZ5Bdi5YMhrN3GtAQI8DjUJgTg0CHxA9ZxokF3XeANNldnKU2tcSa6ZofHzSt-XJUDi3WH93QJbbd0LMFY6mdQ0N2rU Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: b2967018bbd64629a9a49c051c3d1e60 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b2967018bbd64629a9a49c051c3d1e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2967018bbd64629a9a49c051c3d1e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b2967018bbd64629a9a49c051c3d1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2967018bbd64629a9a49c051c3d1e60"}]}] Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: b2967018bbd64629a9a49c051c3d1e60 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-LiveMigrationNegativeTest-867526980-project Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: fd9a2cf92b094c54bdce2e0bf8903af3 Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-LiveMigrationNegativeTest-867526980-project Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '6d3b83d3-e6c6-41ae-bbe9-956b72518a4c'} Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:30.914969 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Returning 404 to user: Instance 6d3b83d3-e6c6-41ae-bbe9-956b72518a4c could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5a3fef3c-38c0-4bab-8a71-aeebbf58b473 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c" status: 404 len: 111 microversion: 2.1 time: 0.073486 Nov 02 12:38:30.920916 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 447/855] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:30 2022] GET /compute/v2.1/servers/6d3b83d3-e6c6-41ae-bbe9-956b72518a4c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:30.932482 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:30.933023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:30.952686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.953288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.953966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:30.957849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:30.958753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:30.959386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.024871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:31.030123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:31.193802 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a7b286c1-66aa-47a2-8cbe-f6437874efb2 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 204 len: 0 microversion: 2.1 time: 0.552805 Nov 02 12:38:31.197435 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 409/856] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:30 2022] DELETE /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:31.203723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.204760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.214549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.215248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.215920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.217062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.218228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.218896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.241729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:31.575644 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9489b651-0568-4ba8-9764-7d50acd168cb tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 204 len: 0 microversion: 2.1 time: 0.651217 Nov 02 12:38:31.579487 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 448/857] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:30 2022] DELETE /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:38:31.584690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0eddab60-7f71-411c-a726-b958c9d24090 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Calling method '.version_select at 0x7eff5c712670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.669480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:31.690266 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-52abc007-aa5c-4056-a197-71a357f60bfc tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1478 microversion: 2.1 time: 0.488906 Nov 02 12:38:31.690943 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 410/858] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1478 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:31.714552 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.719017 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:31.739499 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.750742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.750742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.750742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:31.750742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:31.750742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:31.965671 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0eddab60-7f71-411c-a726-b958c9d24090 tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca/defaults" status: 200 len: 371 microversion: 2.1 time: 0.387234 Nov 02 12:38:31.966845 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 449/859] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca/defaults => generated 371 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:31.983691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:31.991670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.006729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.007208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.010294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.013247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.014161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.016023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.099516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.112873 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b6310d7e-a0cf-4148-a5f9-c268f02def79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1286 microversion: 2.1 time: 0.418647 Nov 02 12:38:32.114854 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 411/860] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1286 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:32.128288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.137565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.150628 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.157177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.157177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.157177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.157177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.157177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.469239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.492384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.496418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.504785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.507392 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e2539eb3-29da-4260-bb13-500c4f1b6624 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1512 microversion: 2.91 time: 0.391434 Nov 02 12:38:32.508635 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 412/861] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1512 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:32.516195 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-88b7f5a7-52da-4b0a-bce8-dae03f1de1d1 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1473 microversion: 2.1 time: 0.548039 Nov 02 12:38:32.538496 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 450/862] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:31 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1473 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:32.542131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c78daf0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:32.685632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.685632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.686056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.687055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.687496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.687929 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.721654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.722541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.735977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.736739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.737421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.738350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.739064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.740627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.978731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:32.992792 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a0116d21-93f3-4194-bfde-d58efcfb5484 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1478 microversion: 2.1 time: 0.276036 Nov 02 12:38:32.998058 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 451/863] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:33.142134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.142792 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.155926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.156435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.161089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.162024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.162546 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.163185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.468869 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.497826 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-08d2362b-6ee0-40ec-83d1-c1304685bc54 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1274 microversion: 2.1 time: 0.360783 Nov 02 12:38:33.525324 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 452/864] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1274 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:33.550755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.553930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.564939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.566775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.567611 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.571552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.572963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.573610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.761000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.770919 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.772472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:33.778111 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c6f0196-76bb-4420-89cf-ac474a497186 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1510 microversion: 2.91 time: 0.236436 Nov 02 12:38:33.778775 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 453/865] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:38:33.783319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:33.783943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.790791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.791320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.791762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.792702 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.793166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.793657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.376871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:34.391545 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-232cc42e-6677-4cf0-a880-70ac5a078537 tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1473 microversion: 2.1 time: 0.610509 Nov 02 12:38:34.395986 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 454/866] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:33 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1473 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:34.411393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:34.413266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:34.434628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.436114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.436834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.437977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.438731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.439493 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.883708 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-19823e2f-3718-4cae-bf1a-bae0ce6f0a8b tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca" status: 200 len: 329 microversion: 2.1 time: 2.373874 Nov 02 12:38:34.885503 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 413/867] 10.222.0.64 () {60 vars in 1263 bytes} [Wed Nov 2 12:38:32 2022] PUT /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca => generated 329 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:34.894634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:34.895699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:34.905049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.905963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.906684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.907951 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:34.908700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:34.909493 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.943019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:35.039363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.055086 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b89ed598-bf15-4821-ab79-79225c84dfbf tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1478 microversion: 2.1 time: 0.657603 Nov 02 12:38:35.055995 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 455/868] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:34 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1478 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:35.061197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.066470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:35.096897 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.098004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.099006 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.100727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.101419 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.102049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.292040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.307929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.310216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.321195 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-49765e2d-7a03-436a-9d63-80d422231513 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1510 microversion: 2.91 time: 0.263931 Nov 02 12:38:35.321803 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 456/869] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1510 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:35.343443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c68cdc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:35.445276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.445766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.446204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.446944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.447403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.447912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.808633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:35.823231 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e6a47184-ec27-44b6-b51d-5d236c0dd3e1 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.936099 Nov 02 12:38:35.825793 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 414/870] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:34 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:35.838902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4521dc35-0cae-430d-931d-42a0f646819e", "name": "network-vif-unplugged", "status": "completed", "tag": "15e01b94-9395-4454-959a-f1ee02b69b22"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:35.872844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.875030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.876768 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.906977 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] Creating event network-vif-unplugged:15e01b94-9395-4454-959a-f1ee02b69b22 for instance 4521dc35-0cae-430d-931d-42a0f646819e on n-h2-857339-6 Nov 02 12:38:35.918549 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-59a37159-4d5c-441c-9dc6-ea57c3b836eb req-b1d6b9f2-b573-4ab5-bfc6-db6b6887dc2f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089734 Nov 02 12:38:35.923076 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 415/871] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:35.933826 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:35.939554 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:35.957155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.958507 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.959333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:35.962107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:35.964719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:35.966967 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.252543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd9a2cf92b094c54bdce2e0bf8903af3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2967018bbd64629a9a49c051c3d1e60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.273757 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e261d907-588b-43a3-896f-3600507b9cbd tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 200 len: 1431 microversion: 2.1 time: 0.348543 Nov 02 12:38:36.275032 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 416/872] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:35 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 1431 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.288950 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.297433 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.318723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.320254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.321954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.323085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.323862 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.324565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.605491 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.619779 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f735e037-4989-47ce-a114-f90036191c9e tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1436 microversion: 2.1 time: 0.342322 Nov 02 12:38:36.624577 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 417/873] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1436 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:36.630509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4521dc35-0cae-430d-931d-42a0f646819e", "name": "network-vif-deleted", "tag": "15e01b94-9395-4454-959a-f1ee02b69b22"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:36.667924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.670578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.671056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.699628 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] Creating event network-vif-deleted:15e01b94-9395-4454-959a-f1ee02b69b22 for instance 4521dc35-0cae-430d-931d-42a0f646819e on n-h2-857339-6 Nov 02 12:38:36.718668 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-d05f6e64-0cd3-4b68-88b1-ce675c2c1408 req-73b87db4-9d2d-4f16-8e69-26b4cc520813 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092592 Nov 02 12:38:36.719322 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 418/874] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:36.740852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:36.745484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:36.769434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.770240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.772141 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.776372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:36.777302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:36.778163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:36.961237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.974954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.977076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:36.987587 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-598d1f0b-cc44-47e3-aaad-bf9871ae0985 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1531 microversion: 2.91 time: 0.258179 Nov 02 12:38:36.995530 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 419/875] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:36 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1531 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:37.005584 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1f3d0af-668e-4219-8242-5c211c9ede0e", "name": "network-vif-deleted", "tag": "433f6a59-c965-48e7-a9d7-ddab10cd09d0"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:37.022961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.023447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.023874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.038424 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] Creating event network-vif-deleted:433f6a59-c965-48e7-a9d7-ddab10cd09d0 for instance b1f3d0af-668e-4219-8242-5c211c9ede0e on n-h2-857339-6 Nov 02 12:38:37.048525 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-8519743e-ecc5-42e5-bf79-565da686d932 req-993b6022-5676-48e7-927e-012740bfbb17 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050633 Nov 02 12:38:37.050469 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 420/876] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:37.069502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:37.070218 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:37.131533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.132161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.132641 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.133447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.133915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.134342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.569759 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:37.584041 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-155532a8-e30f-40f3-949c-7988e5bbcf2b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.528538 Nov 02 12:38:37.597464 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 421/877] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:37 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:37.817655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:37.818343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:37.828055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.828902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.829898 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:37.831437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:37.832102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:37.832814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.079990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lazy-loading 'services' on Instance uuid f81c86aa-9de1-4bea-85c4-3998aea902e0 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:38.102194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=12,nova_api:INSERT=12 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:38.179451 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-41d5bbed-40d0-4d67-bc52-b4b4d4672503 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1936 microversion: 2.91 time: 0.578985 Nov 02 12:38:38.192135 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 422/878] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:37 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1936 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:38.193022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.194650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] [instance: 4521dc35-0cae-430d-931d-42a0f646819e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.202876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.203488 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.204114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.205012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.205744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.206314 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.225674 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] HTTP exception thrown: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Request method failure captured: Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e HTTP/1.1 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmR69_pIBULD0yYdRkUn6jjClOK_JylsigB--IKYFLLKtgFXJRC0LrTcWq84ecJEbRYk9FVvhNTYrtcc79fIuZ5Bdi5YMhrN3GtAQI8DjUJgTg0CHxA9ZxokF3XeANNldnKU2tcSa6ZofHzSt-XJUDi3WH93QJbbd0LMFY6mdQ0N2rU Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: b2967018bbd64629a9a49c051c3d1e60 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b2967018bbd64629a9a49c051c3d1e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2967018bbd64629a9a49c051c3d1e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b2967018bbd64629a9a49c051c3d1e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b2967018bbd64629a9a49c051c3d1e60"}]}] Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: b2967018bbd64629a9a49c051c3d1e60 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-867526980 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-LiveMigrationNegativeTest-867526980-project Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: fd9a2cf92b094c54bdce2e0bf8903af3 Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-LiveMigrationNegativeTest-867526980-project Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '4521dc35-0cae-430d-931d-42a0f646819e'} Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:38.227559 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] Returning 404 to user: Instance 4521dc35-0cae-430d-931d-42a0f646819e could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2de3f4f9-4dec-4bf5-bb58-bfdb328cc6bf tempest-LiveMigrationNegativeTest-867526980 tempest-LiveMigrationNegativeTest-867526980-project] 10.222.0.64 "GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e" status: 404 len: 111 microversion: 2.1 time: 0.043168 Nov 02 12:38:38.232235 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 423/879] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/4521dc35-0cae-430d-931d-42a0f646819e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:38.235938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.236682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.243272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.243777 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.244202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.244949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.245467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.246643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.310844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.312664 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.313326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.313954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lazy-loading 'fault' on Instance uuid b1f3d0af-668e-4219-8242-5c211c9ede0e {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:38.446523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddec067445d54223aa49c8a5ec9dea6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eca4631088f4e8e9b23c9070680dbee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:38.456357 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3399e3be-a1b3-4560-8bdf-887430d07141 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 200 len: 1313 microversion: 2.1 time: 0.224908 Nov 02 12:38:38.457019 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 424/880] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:38.462385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.463696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.477075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.479030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.479030 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.479250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.479614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.480102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.657980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lazy-loading 'services' on Instance uuid f81c86aa-9de1-4bea-85c4-3998aea902e0 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:38.689551 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b8552ca7-bd22-4729-9596-2bb5a82f3843 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1936 microversion: 2.91 time: 0.231329 Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 425/881] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1936 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.704516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.705336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.705888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.706406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.746349 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f2c99d21-402d-4ec8-94df-1c9dd12082fb tempest-QuotasAdminTestJSON-1769777878 tempest-QuotasAdminTestJSON-1769777878-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca" status: 200 len: 329 microversion: 2.1 time: 3.417909 Nov 02 12:38:38.752572 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 457/882] 10.222.0.64 () {60 vars in 1263 bytes} [Wed Nov 2 12:38:35 2022] PUT /compute/v2.1/os-quota-sets/03aa3a57c2b04d8ca26d6b56f9163aca => generated 329 bytes in 3420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:38.753130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:38.771660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.772431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.773204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.774191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.775435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.776199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.807997 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7f52ef67-3ac6-4973-b4ef-cd2b3b4f11f3 tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.058567 Nov 02 12:38:38.809249 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 458/883] 10.222.0.64 () {60 vars in 1217 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:38:38.828220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:38.858327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.859882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.862966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.893118 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] Creating event network-changed:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:38:38.905398 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-0498b769-e5a8-4166-a1ed-14716a8731e3 req-7cceb549-9931-49f9-91e1-71105d68a571 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090875 Nov 02 12:38:38.914957 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 459/884] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:38.925934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:38.943264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:38.963135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.963446 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.963878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.964707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:38.965296 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:38.965861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:38.997674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lazy-loading 'flavor' on Instance uuid f81c86aa-9de1-4bea-85c4-3998aea902e0 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:39.036973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:39.053491 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3ab711c5-ef28-4ea8-aaf0-4cdfcac63c35 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.361376 Nov 02 12:38:39.072129 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 426/885] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:38 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:39.632649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Calling method '.version_select at 0x7eff5c6f5b80>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.819690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:39.820570 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Neutron security group e839c076-c794-4d38-a202-6f6c9e59ca8c not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:38:39.822775 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] HTTP exception thrown: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.822775 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Request method failure captured: Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-security-groups/e839c076-c794-4d38-a202-6f6c9e59ca8c HTTP/1.1 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTO-8qCwNczVlkdh_Ulx49k5rTuIO2z84VIU6XWEP5U6f1QNEaUzOSFOFyBOOizKfyYHAvlqPDkMNwBqM-zM6t8mpDMQAXI_ko3cN5v8CKXXMKNrOuW2wVJulhaNwv1Gzs2f2CPMl8VcQOCQu9WZaTo1QUIKir_H3WE0H4se5sZujA Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0303fb8fa1924311b8b0c54f77aab51e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}] Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 469e933c7f8042e48c20972431265685 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e839c076-c794-4d38-a202-6f6c9e59ca8c'} Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:39.826192 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Returning 404 to user: Security group e839c076-c794-4d38-a202-6f6c9e59ca8c does not exist Nov 02 12:38:39.830193 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-ed9fcdc0-dca1-468f-986f-53f0fdebd4ae'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:39.833428 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-54907286-9189-404f-a76d-9a3c953b6d67 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/e839c076-c794-4d38-a202-6f6c9e59ca8c" status: 404 len: 194 microversion: 2.1 time: 0.699917 Nov 02 12:38:39.833428 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 427/886] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:39 2022] DELETE /compute/v2.1/os-security-groups/e839c076-c794-4d38-a202-6f6c9e59ca8c => generated 194 bytes in 701 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:38:39.851241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.852856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] [instance: b1f3d0af-668e-4219-8242-5c211c9ede0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:39.874457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.877822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.887310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.887310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.887310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.887310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.930545 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-649e56e7-42b2-4309-a7fd-eaf3688fcd52 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "POST /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0/action" status: 202 len: 0 microversion: 2.91 time: 1.013249 Nov 02 12:38:39.931618 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 460/887] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:38:38 2022] POST /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0/action => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:39.936342 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] HTTP exception thrown: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Request method failure captured: Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e HTTP/1.1 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmSu93z0VW6UIOy7FGVYl0_N1inOlUHb2hC9A_4f7LTFU7PZnYhG8w_BU-Wzma3m_jJ2660FrEXoxkEJwU6DYdTHj_nhopT4_9VWxxX-GY9KlQY4ehvyfHZJ_QkJC5kLZgvpPRqkkqNHpfq5VkaOaValcbdzvh1ys8wEH7KAlLjyCT8 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4eca4631088f4e8e9b23c9070680dbee Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4eca4631088f4e8e9b23c9070680dbee", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4eca4631088f4e8e9b23c9070680dbee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4eca4631088f4e8e9b23c9070680dbee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4eca4631088f4e8e9b23c9070680dbee"}]}] Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4eca4631088f4e8e9b23c9070680dbee Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2134958545 Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerDiagnosticsNegativeTest-2134958545-project Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ddec067445d54223aa49c8a5ec9dea6b Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2134958545-project Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'b1f3d0af-668e-4219-8242-5c211c9ede0e'} Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.953093 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. Nov 02 12:38:39.962781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:39.963406 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5f72b2b1-19c8-4c87-b54d-093a07eaa0c6 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.021250 Nov 02 12:38:39.963505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] Returning 404 to user: Instance b1f3d0af-668e-4219-8242-5c211c9ede0e could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:39.963505 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-320ea5a7-626a-4fdc-a6a8-e652eff655a3 tempest-ServerDiagnosticsNegativeTest-2134958545 tempest-ServerDiagnosticsNegativeTest-2134958545-project] 10.222.0.64 "GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e" status: 404 len: 111 microversion: 2.1 time: 0.126823 Nov 02 12:38:39.963505 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 428/888] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/servers/b1f3d0af-668e-4219-8242-5c211c9ede0e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:39.966768 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 461/889] 10.222.0.64 () {58 vars in 1164 bytes} [Wed Nov 2 12:38:39 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:38:39.970806 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:39.971659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:39.979643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.980425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.981857 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.982842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:39.983521 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:39.984153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:39.993972 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9cba4919-2555-4670-b56c-c97ca04f1162 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Calling method '.version_select at 0x7eff5c60fe50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:40.223748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:40.235994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:40.240009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:40.248348 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-25aea149-9f85-42a7-9419-74ab2e1ed8e1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.286655 Nov 02 12:38:40.249447 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 429/890] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:40.256004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:40.257792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:40.271970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.272473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.272939 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.273647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.274104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.274524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.169879 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9cba4919-2555-4670-b56c-c97ca04f1162 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.201570 Nov 02 12:38:41.182174 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 462/891] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:38:39 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:41.188013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Calling method '.version_select at 0x7eff5c526280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:41.201214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:41.216745 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2ffa0821-6124-4c34-b9c3-9380aa398dbf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.961717 Nov 02 12:38:41.216745 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 430/892] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:40 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:41.279443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:41.280349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:41.294239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:41.295422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:41.296347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.298320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:41.299014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:41.299607 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:41.495437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:41.511867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:41.514105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:41.522278 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0e406812-23c3-4c40-9551-c567a20c1bd6 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.246711 Nov 02 12:38:41.523588 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 431/893] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:41 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:41.606029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:41.607030 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] HTTP exception thrown: Insufficient rights for removing default security group. Nov 02 12:38:41.607030 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Request method failure captured: Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-security-groups/f872933d-257d-4e84-bb73-bdda62501452 HTTP/1.1 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTO-8qCwNczVlkdh_Ulx49k5rTuIO2z84VIU6XWEP5U6f1QNEaUzOSFOFyBOOizKfyYHAvlqPDkMNwBqM-zM6t8mpDMQAXI_ko3cN5v8CKXXMKNrOuW2wVJulhaNwv1Gzs2f2CPMl8VcQOCQu9WZaTo1QUIKir_H3WE0H4se5sZujA Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0303fb8fa1924311b8b0c54f77aab51e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}] Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 469e933c7f8042e48c20972431265685 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: exception: Insufficient rights for removing default security group. Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'f872933d-257d-4e84-bb73-bdda62501452'} Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:41.609556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] Nov 02 12:38:41.613947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.622805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Returning 400 to user: Insufficient rights for removing default security group. Nov 02 12:38:41.622805 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1516070c-5a80-4171-9f3d-92157b046416'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:41.623969 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e44ada5b-92a4-4ff7-b5d3-8ccee5dc1ca7 tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/f872933d-257d-4e84-bb73-bdda62501452" status: 400 len: 182 microversion: 2.1 time: 0.439893 Nov 02 12:38:41.625908 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 463/894] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:38:41 2022] DELETE /compute/v2.1/os-security-groups/f872933d-257d-4e84-bb73-bdda62501452 => generated 182 bytes in 442 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:38:41.642957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Calling method '.version_select at 0x7eff5c890550>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:41.717724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:41.718805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Neutron security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:38:41.719932 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] HTTP exception thrown: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.719932 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Request method failure captured: Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-security-groups/5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 HTTP/1.1 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTO-8qCwNczVlkdh_Ulx49k5rTuIO2z84VIU6XWEP5U6f1QNEaUzOSFOFyBOOizKfyYHAvlqPDkMNwBqM-zM6t8mpDMQAXI_ko3cN5v8CKXXMKNrOuW2wVJulhaNwv1Gzs2f2CPMl8VcQOCQu9WZaTo1QUIKir_H3WE0H4se5sZujA Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0303fb8fa1924311b8b0c54f77aab51e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}] Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 469e933c7f8042e48c20972431265685 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0'} Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:41.722334 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] Nov 02 12:38:41.726225 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.730586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Returning 404 to user: Security group 5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 does not exist Nov 02 12:38:41.730586 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-2a1847b1-ccfe-4f49-b252-427ddb23db8e'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:41.731709 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4bd24d03-f1e5-4fd1-941b-746a3806f90c tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0" status: 404 len: 194 microversion: 2.1 time: 0.093235 Nov 02 12:38:41.733525 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 432/895] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:38:41 2022] GET /compute/v2.1/os-security-groups/5d15a3aa-c9b0-4e72-9bdc-0a4b1c90a7f0 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:41.743404 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Action: 'update', calling method: .version_select at 0x7eff5c5514c0>, body: {"security_group": {"name": "tempest-sg-1610726037", "description": "tempest-description-458370123"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:41.783071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:38:41.784188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Neutron security group 6e0d7c63-0faa-46db-b3c2-48303b636474 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:38:41.785024 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] HTTP exception thrown: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.785024 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Request method failure captured: Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: request: PUT /compute/v2.1/os-security-groups/6e0d7c63-0faa-46db-b3c2-48303b636474 HTTP/1.1 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 101 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTO-8qCwNczVlkdh_Ulx49k5rTuIO2z84VIU6XWEP5U6f1QNEaUzOSFOFyBOOizKfyYHAvlqPDkMNwBqM-zM6t8mpDMQAXI_ko3cN5v8CKXXMKNrOuW2wVJulhaNwv1Gzs2f2CPMl8VcQOCQu9WZaTo1QUIKir_H3WE0H4se5sZujA Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0303fb8fa1924311b8b0c54f77aab51e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0303fb8fa1924311b8b0c54f77aab51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0303fb8fa1924311b8b0c54f77aab51e"}]}] Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0303fb8fa1924311b8b0c54f77aab51e Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-399263997 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 469e933c7f8042e48c20972431265685 Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-399263997-project Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: {"security_group": {"name": "tempest-sg-1610726037", "description": "tempest-description-458370123"}} Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '6e0d7c63-0faa-46db-b3c2-48303b636474', 'body': {'security_group': {'name': 'tempest-sg-1610726037', 'description': 'tempest-description-458370123'}}} Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:38:41.788474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] Returning 404 to user: Security group 6e0d7c63-0faa-46db-b3c2-48303b636474 does not exist Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1ccccdeb-bbe7-4d3d-864e-5976d6c0208f'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:41.795044 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dfa47329-cdf6-4cf7-8e41-0cd294eb9d3e tempest-SecurityGroupsNegativeTestJSON-399263997 tempest-SecurityGroupsNegativeTestJSON-399263997-project] 10.222.0.64 "PUT /compute/v2.1/os-security-groups/6e0d7c63-0faa-46db-b3c2-48303b636474" status: 404 len: 194 microversion: 2.1 time: 0.051390 Nov 02 12:38:41.807003 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 464/896] 10.222.0.64 () {60 vars in 1290 bytes} [Wed Nov 2 12:38:41 2022] PUT /compute/v2.1/os-security-groups/6e0d7c63-0faa-46db-b3c2-48303b636474 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:42.240565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.243821 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.268828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.269329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.271103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.273053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.276016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.277495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.552858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.553394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.570543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.571392 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.572000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.572924 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.573630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.574220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.721213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=19 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:42.743912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.753328 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.761826 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.772951 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-22eb27f4-3fad-4f33-b7a5-9223715326b8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.224026 Nov 02 12:38:42.775965 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 465/897] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:38:42.911878 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.920271 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-44e6ffe8-497e-4f89-b543-55253057a9c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.684895 Nov 02 12:38:42.943128 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 433/898] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:43.803673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.806501 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.814784 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.815567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.816207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.817181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.817875 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.818533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.901719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-plugged", "status": "completed", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:43.922517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=14 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:43.922517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.922517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.922517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.938000 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] Creating event network-vif-plugged:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:38:43.949351 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-d132c7d8-0071-487d-876d-819b72e7b34e req-54fee329-1c30-4506-86bd-eb8d4d022f10 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051317 Nov 02 12:38:43.956726 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 434/899] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:43.957876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.960620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.968273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.969090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.969689 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.970564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.971172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.971820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.077216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.095889 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.099001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.126115 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a3826619-77a3-4abf-96f2-3c1323c9ed3c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.321884 Nov 02 12:38:44.127989 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 466/900] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:44.376906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.387877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:44.392114 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ced39594-75ad-443e-bc46-e429843b75c0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.439227 Nov 02 12:38:44.409028 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 435/901] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:45.165496 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.167592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.192574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.196658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.198751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.202574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.203412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.205412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.309985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:45.324177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:45.330498 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:45.346427 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c4ce1f56-077e-4178-a9ef-3653504015a0 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.188125 Nov 02 12:38:45.347302 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 467/902] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:45.417906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.419934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.443965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=70 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:45.449196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.451426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.456321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.457427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.458298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.458774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.937326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:45.954181 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c8657eaa-9615-4092-8b38-44d2388a31b7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1316 microversion: 2.1 time: 0.542425 Nov 02 12:38:45.970393 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 436/903] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1316 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:46.381846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:46.382506 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:46.404717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:46.407282 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:46.407820 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:46.416399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:46.419672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:46.435300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:46.777962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.787112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.789275 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:46.799254 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cab6b989-1b4e-4761-ab24-fc8a720caf85 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.421283 Nov 02 12:38:46.800793 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 468/904] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:46 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:46.981283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:46.982108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.000190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.002048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.005441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.006678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.009363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.009363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.352621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:47.376708 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d2a93b74-5177-4e28-8b43-02a3c16477bb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1466 microversion: 2.1 time: 0.388973 Nov 02 12:38:47.376708 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 437/905] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:46 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1466 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:47.391045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-685299793", "metadata": {"image_type": "test"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:47.394135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.404243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.404982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.405655 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.406405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.406862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.407285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.450104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Getting quotas for project 607346d5cd14420f930647ff1ecdb94d. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:47.457862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Getting quotas for user 63589f909a744bf1afec7d1f2e659f8a and project 607346d5cd14420f930647ff1ecdb94d. Resources: dict_keys(['metadata_items']) {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:47.467228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:47.829329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:47.834889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:47.856281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.860027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.860812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:47.862913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:47.866183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:47.867024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.003396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:48.014370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:48.016384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:48.029967 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-93183970-6ddf-4eaf-bdaa-e87845d584dc tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.205003 Nov 02 12:38:48.031354 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 438/906] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:47 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:48.199843 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c51b3fdb-913c-4322-b9da-af9509d176ca tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "POST /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73/action" status: 202 len: 0 microversion: 2.1 time: 0.808690 Nov 02 12:38:48.204203 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 469/907] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:38:47 2022] POST /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:38:48.218483 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b67976c-c9a7-4535-a6b6-00fa7219bbaa tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c559dc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.328901 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4b67976c-c9a7-4535-a6b6-00fa7219bbaa tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.116531 Nov 02 12:38:48.333745 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 470/908] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:48.638885 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1730497089", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:48.720047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:49.062675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=54 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:49.064394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=12 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:49.070079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.072165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:49.117668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.119537 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.123266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.125994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.132387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.140709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f6e6613f-0fd2-4b10-93dd-a5925a36d133) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:49.240521 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f6e6613f-0fd2-4b10-93dd-a5925a36d133) Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 207 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1730497089", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1730497089', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:49.246631 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:49.251234 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f6e6613f-0fd2-4b10-93dd-a5925a36d133) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5126ffb2-0fbc-420f-8d0a-68d46f66b249 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.213752 Nov 02 12:38:49.258052 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 439/909] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1215 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:49.447320 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:49.487956 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:49.491983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:49.512554 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ee3a2e66-a898-4aee-8357-51c212370b1d tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.451299 Nov 02 12:38:49.513432 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 471/910] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:49.535795 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d8d49b8-6c7a-49eb-8702-47449a53dd79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4ee550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.630610 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d8d49b8-6c7a-49eb-8702-47449a53dd79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.115892 Nov 02 12:38:49.631087 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 472/911] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.648558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-352609253", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:49.782251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:49.833957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-097872f8-7e36-4709-949c-32e5cf21f081 tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] Calling method '.version_select at 0x7eff5ce47ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.197093 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-097872f8-7e36-4709-949c-32e5cf21f081 tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] 10.222.0.64 "GET /compute/v2.1/os-networks" status: 200 len: 3308 microversion: 2.1 time: 0.948612 Nov 02 12:38:50.208337 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 440/912] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/os-networks => generated 3308 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:50.215183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a633b42a-319c-494d-8357-56c45a48d5d3 tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] Calling method '.version_select at 0x7eff5d314a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.355088 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a633b42a-319c-494d-8357-56c45a48d5d3 tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] 10.222.0.64 "GET /compute/v2.1/os-networks/66ab45f6-fff6-43fb-9582-29b239eb5a72" status: 200 len: 652 microversion: 2.1 time: 0.145249 Nov 02 12:38:50.355918 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 441/913] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/os-networks/66ab45f6-fff6-43fb-9582-29b239eb5a72 => generated 652 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:50.374067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9998bad7-b5f6-41ad-a738-b287de4a3edc tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] Calling method '.version_select at 0x7eff5c838ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.492726 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9998bad7-b5f6-41ad-a738-b287de4a3edc tempest-NetworksTest-1570644986 tempest-NetworksTest-1570644986-project-admin] 10.222.0.64 "GET /compute/v2.1/os-networks" status: 200 len: 3308 microversion: 2.1 time: 0.122743 Nov 02 12:38:50.493291 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 442/914] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/os-networks => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:50.548819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.550998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:50.561995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.563187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.564187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.565193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:50.565943 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:50.566183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:50.608382 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29) Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 206 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-DeleteServersTestJSON-server-352609253", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-352609253', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:50.618271 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:50.623348 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2e3a4d64-cc17-4113-ad36-14a2d3c47b29) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d94393da-db11-4d81-abc4-d62a94e5503d tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.980614 Nov 02 12:38:50.632736 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 473/915] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 982 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:50.649940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-18d11d4e-e796-4532-980c-50a1f5e54594 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c6055e0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:50.684660 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.691723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.693763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.713126 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bf5739b4-4a5a-4ab4-9546-d815b03fb643 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.171497 Nov 02 12:38:50.713714 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 443/916] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:50.727145 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-18d11d4e-e796-4532-980c-50a1f5e54594 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.083735 Nov 02 12:38:50.729238 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 474/917] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:50 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:51.182123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1425291978", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:51.303459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:51.749653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d24fd97-0d88-4915-bd6d-5d510aa4050d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c559790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.828683 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1d24fd97-0d88-4915-bd6d-5d510aa4050d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.086432 Nov 02 12:38:51.829002 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 475/918] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:51.836412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.837064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b03b4f0-f191-4ae1-9034-d69db613def7) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:51.866695 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b03b4f0-f191-4ae1-9034-d69db613def7) Nov 02 12:38:51.873803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.874768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.874768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 207 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1425291978", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1425291978', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:51.875023 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-6b03b4f0-f191-4ae1-9034-d69db613def7) Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:51.880051 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.891661 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:51.912337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.912337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.912337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.912337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.912860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:51.912860 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:51.912860 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a7e473c5-47df-4e42-b9c9-abb597033728 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.708461 Nov 02 12:38:51.912860 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 444/919] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 720 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:52.018783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.043935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.047354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.061318 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ad8902f3-a4fe-4044-acf0-cdb5aae84a89 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.229889 Nov 02 12:38:52.075149 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 476/920] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:52.458900 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-809151879", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:52.593139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:52.848321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dd7fb50b-f7f2-44d4-a372-60381ce214bd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c60fdc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:52.952736 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dd7fb50b-f7f2-44d4-a372-60381ce214bd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.112161 Nov 02 12:38:52.964571 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 477/921] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:52 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:53.103045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.103673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:53.122154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.123271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.123724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.124468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.130443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.131107 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:53.285438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb) Nov 02 12:38:53.289451 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.291878 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:53.291878 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 206 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-DeleteServersTestJSON-server-809151879", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-809151879', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:53.294991 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d97ca7f0-89d8-4f6f-bf6a-3db818c80bdb) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:53.301150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3fac4548-727f-44d0-8c73-fce8977aae50 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.857254 Nov 02 12:38:53.316417 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 445/922] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 861 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:53.417339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.431742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.433884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.455433 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b4c00ef0-32e9-45bf-b9ca-ef1de6208b83 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.358640 Nov 02 12:38:53.477074 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 478/923] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:38:54.041213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1587831217", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:54.120391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-525070153", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:54.135321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:54.239015 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:54.246736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:54.246736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:54.246736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:54.246736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:54.284221 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.289712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.292544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.293760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.294322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.294771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.338450 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Getting quotas for project b8ee21f74a1d415f9f42599927a503d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:54.345741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Getting quotas for user da4d37ab3d0b40d59bdba72582fa86ad and project b8ee21f74a1d415f9f42599927a503d8. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:54.365498 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:54.370173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:54.476393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:54.479038 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:54.479766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:54.480361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:54.481026 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:54.496720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.497793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.498672 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.499678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.500399 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.501341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.527782 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:54.535783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:54.569753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:54.572341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:54.574734 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2aea174b-e42b-45c6-badf-7ce94ea8906d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 1.096172 Nov 02 12:38:54.583486 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 479/924] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:38:54.583486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-plugged", "status": "completed", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:54.608810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.609406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.609942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.635331 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] Creating event network-vif-plugged:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:38:54.643129 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-93bc168b-5f5c-4b12-96de-37692fc6fd29 req-9a7e436f-adae-4946-bcf7-73b7b9ad2cd5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065671 Nov 02 12:38:54.644421 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 480/925] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:54.653558 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2121500486", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:54.731780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:54.777352 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ee6f5382-baa9-478e-b280-b8a3973d3d0b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460500 Nov 02 12:38:54.778941 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 446/926] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:54.788798 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ef10c462-ec72-43e6-b864-4f864c47d762 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4f8430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.910216 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ef10c462-ec72-43e6-b864-4f864c47d762 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.127979 Nov 02 12:38:54.910216 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 447/927] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:54.924430 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.948186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:54.962807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.963523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.965001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.965758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.966224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.966700 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.337049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.368053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.369879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.378008 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb685865-d7a0-4449-a29d-366cc07f17cd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.465220 Nov 02 12:38:55.379514 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 448/928] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:55.388461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:55.399900 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.646244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.656013 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.666955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:55.680199 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c54eb9b8-c619-4ad6-b29a-60d636969391 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "PUT /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1358 microversion: 2.75 time: 0.298410 Nov 02 12:38:55.685696 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 449/929] 10.222.0.64 () {62 vars in 1297 bytes} [Wed Nov 2 12:38:55 2022] PUT /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:55.712819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1b0bd2c1-9f6c-4699-8bde-af3a3ef7ddf7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.716304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1b0bd2c1-9f6c-4699-8bde-af3a3ef7ddf7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:55.739331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64) Nov 02 12:38:55.743188 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.747341 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:55.747341 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 207 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-DeleteServersTestJSON-server-2121500486", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-2121500486', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:55.750805 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-74d2b45e-4c3b-4bc6-b8e2-f47f4bafce64) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:55.755778 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.762637 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:55.764851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:55.764851 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:55.768826 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c4010537-db66-429c-9134-6dd3da86e7de tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.122290 Nov 02 12:38:55.773001 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 481/930] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:54 2022] POST /compute/v2.1/servers => generated 214 bytes in 1128 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:55.779137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.786373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:56.030773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1b0bd2c1-9f6c-4699-8bde-af3a3ef7ddf7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.039408 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1b0bd2c1-9f6c-4699-8bde-af3a3ef7ddf7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1217 microversion: 2.1 time: 0.349554 Nov 02 12:38:56.040050 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 450/931] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:56.157444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.172973 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.176954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.210219 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d531228b-c923-4bdc-a640-85748424ab49 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1358 microversion: 2.75 time: 0.432249 Nov 02 12:38:56.216170 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 482/932] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:56.226176 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-853a00e0-c73b-43d8-a3fa-e3a6fa57e1a5 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c5511f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.344758 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-853a00e0-c73b-43d8-a3fa-e3a6fa57e1a5 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.126600 Nov 02 12:38:56.353637 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 483/933] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:56 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:56.371224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1154215536", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:56.511356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:56.978618 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:56.982429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.992425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.998283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.998283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:56.998283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:56.998283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.054934 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0317e73b-13aa-4d5e-85da-03bdf52e0fd7 tempest-AZV2TestJSON-1526445336 tempest-AZV2TestJSON-1526445336-project] 10.222.0.64 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.996447 Nov 02 12:38:57.067410 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 451/934] 10.222.0.64 () {58 vars in 1164 bytes} [Wed Nov 2 12:38:56 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:57.072007 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce) Nov 02 12:38:57.076668 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.077898 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:57.077898 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:57.086269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 207 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-DeleteServersTestJSON-server-1154215536", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-1154215536', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:57.086513 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7cafdf76-73f9-4ce5-b68d-3d3ba63f38ce) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:57.090191 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.095320 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:57.099371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.099531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:57.099531 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:57.101737 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b56d70f7-c8d2-48b4-b222-bcc888215b51 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.725573 Nov 02 12:38:57.103169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.105301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.112443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.117626 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 484/935] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:56 2022] POST /compute/v2.1/servers => generated 214 bytes in 763 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:57.118706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.119730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.124625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.141865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.153568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.231432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.232379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.233794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.234781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.235746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.236399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.314894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.331895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.338755 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.365027 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0d2f4060-c58d-4e96-a7bc-ed11a368586c tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.297639 Nov 02 12:38:57.369702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 452/936] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:57.387617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.394425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.416545 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.419583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.419583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.419583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.419583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.419583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.426793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.437590 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-608f7701-dfff-4e50-9ed2-f6b3b51af281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1221 microversion: 2.1 time: 0.317931 Nov 02 12:38:57.453842 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 485/937] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1221 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.471731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9e0590e1-051f-4490-8d87-802aec26d15e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c60fd30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.607903 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9e0590e1-051f-4490-8d87-802aec26d15e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.150805 Nov 02 12:38:57.621431 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 486/938] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.675001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.699983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.701716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.761066 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-badaa0c4-1c75-4302-b997-8955f51611a3 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1362 microversion: 2.75 time: 0.389820 Nov 02 12:38:57.770366 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 453/939] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:57.969960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-285409931", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:58.119501 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] validate_networks() for [('36eee474-f275-427e-a4df-a4d5668b4246', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:58.400430 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.402131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:58.412111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.416758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.419625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.425973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.429601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.433109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63808bd7-e381-450b-9b70-13c2a87c85e9) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:58.568028 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63808bd7-e381-450b-9b70-13c2a87c85e9) Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:58.571892 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Request method failure captured: Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 206 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTXzNmGDWgGI8MiNilJ-xz7wwOPiSFbWjbDhgE4qP5z5L-QKKdfavUbJJ1d7Tr38V3seYr1aXZPE3Ydufxln-hJOhLIC9GUQpG09vrRuJDwdc5PzLoczV96T473WFyIBfWX8adnndr6Im_mDT2pA7wU4G34VxMT28t4rTPkAC4rH-w Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2661419fee8c481faece16d1eca7f028", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2661419fee8c481faece16d1eca7f028"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2661419fee8c481faece16d1eca7f028"}]}] Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2661419fee8c481faece16d1eca7f028 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1432968260 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6721290bdc314f36b106d2eabdda3790 Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersTestJSON-1432968260-project Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-DeleteServersTestJSON-server-285409931", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "36eee474-f275-427e-a4df-a4d5668b4246"}]}} Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-285409931', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '36eee474-f275-427e-a4df-a4d5668b4246'}]}}} Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:38:58.573048 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-63808bd7-e381-450b-9b70-13c2a87c85e9) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:38:58.589241 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ac640663-3f2d-4a23-9e81-602311e15ce9 tempest-DeleteServersTestJSON-1432968260 tempest-DeleteServersTestJSON-1432968260-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.609577 Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 487/940] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:57 2022] POST /compute/v2.1/servers => generated 214 bytes in 611 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.598128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:58.614050 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.614942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.615616 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.616687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.617376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.619598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.665188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.680455 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.682123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.691588 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5e99e6fb-98fb-471e-9220-155ef2f14134 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.296994 Nov 02 12:38:58.697011 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 454/941] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:58.704651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a46460dc-5110-4bde-8f10-72c4faf9b4ac tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5d0e91f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.745908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.771042 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9963c1d7-5b4d-439a-ba2c-b633e3f44309 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1213 microversion: 2.1 time: 0.195345 Nov 02 12:38:58.774069 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 488/942] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:58.784065 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a46460dc-5110-4bde-8f10-72c4faf9b4ac tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.085677 Nov 02 12:38:58.788744 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 455/943] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:58.806927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.810318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:58.838185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.839529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.841605 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.843658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.846934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.848278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.971532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.003846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.005885 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.016449 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-11359b25-d78c-48c0-8f4a-36e9f0b1caaf tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1410 microversion: 2.75 time: 0.228478 Nov 02 12:38:59.017610 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 489/944] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1410 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:59.727357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.727990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.741698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.752158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.752158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.752158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.752158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.752158 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.806052 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.806686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.817319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=92,nova_api:INSERT=5 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:59.820269 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.827377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.831470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.832709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.835657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.839294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.882025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.894350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.896148 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.904618 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1703c2a1-37b8-4f9a-9f5d-069c13d957e9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.181864 Nov 02 12:38:59.905943 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 456/945] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:38:59.912288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2b19af7e-abf3-47a6-ab21-aa37c56ddc94 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5ccb6820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.998721 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2b19af7e-abf3-47a6-ab21-aa37c56ddc94 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.089019 Nov 02 12:39:00.000381 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 457/946] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:00.049370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.049793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.051438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.061263 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-17e8b6eb-2694-4db7-b4dc-eeaba5062e30 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1269 microversion: 2.1 time: 0.262037 Nov 02 12:39:00.062766 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 490/947] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:00.065691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.066389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.066841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.067587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.068369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.068834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.237870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.275136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.279978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:00.305481 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66513c0e-845d-4537-9794-5dd41b46f1e6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1416 microversion: 2.75 time: 0.259820 Nov 02 12:39:00.306313 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 458/948] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1416 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:00.942688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:00.946152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:00.971836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.996036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.996036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.996036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.996036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.996036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.017447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d6d5aef2-0932-42cb-a7ff-320c0546f779 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c5c2f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.102572 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d6d5aef2-0932-42cb-a7ff-320c0546f779 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.088725 Nov 02 12:39:01.108143 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 459/949] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:01.123770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.128438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:01.172469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.178382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.183385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.183385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.197046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.197591 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.363753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.380877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.383153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.400291 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eb6f7e8f-a7ab-4da5-a48d-70231c0f0bc8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.460867 Nov 02 12:39:01.400291 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 491/950] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:00 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:01.409004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:01.413094 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:01.428016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.428802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.433579 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.434359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:01.434841 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:01.435409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:01.492994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.506630 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bdf0b941-7646-4baa-8f9c-9e7c07740ecf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1277 microversion: 2.1 time: 0.395709 Nov 02 12:39:01.507243 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 460/951] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:01.665783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.681706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.685366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:01.700460 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-70f919f9-81f1-4f7d-9d29-ed4f0b5d321a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1416 microversion: 2.75 time: 0.297244 Nov 02 12:39:01.702920 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 492/952] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:01 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1416 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:02.344983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c6f5670>, body: {"quota_set": {"ram": "5120"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:02.430385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9b862846-b073-41d5-a90c-8ac7ca7d0bed tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Calling method '.version_select at 0x7eff5c551b80>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.536269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.536975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.537470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.538453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.538971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.539426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.646868 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9b862846-b073-41d5-a90c-8ac7ca7d0bed tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.593162 Nov 02 12:39:02.647530 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 493/953] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:39:02.655851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87ec8696-a724-4df0-9104-8f9603118b7c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c551e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.771304 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-87ec8696-a724-4df0-9104-8f9603118b7c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.119466 Nov 02 12:39:02.772323 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 494/954] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:02.785762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.794892 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-64a26d29-9b07-4ee1-afcd-68a7bf910e1b tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064" status: 200 len: 148 microversion: 2.57 time: 0.854592 Nov 02 12:39:02.795898 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 461/955] 10.222.0.64 () {62 vars in 1303 bytes} [Wed Nov 2 12:39:01 2022] PUT /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064 => generated 148 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:02.799120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.817035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:02.821469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.822596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:02.831032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.832432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.833251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.833730 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.834170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.846786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.851973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.854660 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:02.856252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:02.866756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:02.867563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.101035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.113932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.121049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.127784 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e959329e-12bc-42b2-a46e-01ef6e168e6c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1275 microversion: 2.1 time: 0.326692 Nov 02 12:39:03.127900 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 462/956] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1275 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:03.143224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.154527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-07475e74-73e0-4d50-b444-3bb392d23cde tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Action: 'create', calling method: .version_select at 0x7eff5c5c21f0>, body: {"pool": "non_exist_pool"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:03.156940 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-22584ff6-3f88-4a87-89e2-8e21401197a1 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.381529 Nov 02 12:39:03.161682 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 495/957] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:02 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:03.172200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.172200 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.202059 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.210170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.210170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.210170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.210170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.210170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.289106 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-07475e74-73e0-4d50-b444-3bb392d23cde tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] HTTP exception thrown: Floating IP pool not found. Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-07475e74-73e0-4d50-b444-3bb392d23cde tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Request method failure captured: Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 26 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTlYZVPWyJKOFo7TeDAchfSzX_-QUfOPLdvptwrS7NduWFE7PJQqXUXqpSyRpJ0X_rIeJb-L67JAIn-b2bJErsLaNyN-n57ZZdNdhyTq2MaKgcfGaCCTeI1-CyubNJ9_wc1MqjISiEOAnYkKU2hnbyE_qmievwLvAH1QhR78Nz7eCc Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f97dff96032f4f2193acabe74c8b69bd Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f97dff96032f4f2193acabe74c8b69bd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f97dff96032f4f2193acabe74c8b69bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f97dff96032f4f2193acabe74c8b69bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f97dff96032f4f2193acabe74c8b69bd"}]}] Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f97dff96032f4f2193acabe74c8b69bd Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FloatingIPsNegativeTestJSON-1126547122-project Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 480ecf0ebd274b5aa533822f4672dd00 Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1126547122-project Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: {"pool": "non_exist_pool"} Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: exception: Floating IP pool not found. Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'pool': 'non_exist_pool'}} Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:03.291043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:03.297585 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Nov 02 12:39:03.297585 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.299161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-07475e74-73e0-4d50-b444-3bb392d23cde tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Returning 404 to user: Floating IP pool not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:03.300824 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-07475e74-73e0-4d50-b444-3bb392d23cde tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.149841 Nov 02 12:39:03.301638 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 463/958] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:39:03 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:39:03.336532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Calling method '.version_select at 0x7eff5c6f5af0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.461925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.494933 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.499178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:03.533830 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-44fd5e54-ffa4-406b-b786-6aab07e63a74 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1437 microversion: 2.75 time: 0.365025 Nov 02 12:39:03.538965 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 496/959] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1437 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:03.574843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Calling method '.version_select at 0x7eff5c516040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:03.662524 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 533dba6e-0b2a-434f-b9d9-83b50f605b7c could not be found", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:39:03.663527 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] HTTP exception thrown: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Request method failure captured: Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-floating-ips/533dba6e-0b2a-434f-b9d9-83b50f605b7c HTTP/1.1 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTlYZVPWyJKOFo7TeDAchfSzX_-QUfOPLdvptwrS7NduWFE7PJQqXUXqpSyRpJ0X_rIeJb-L67JAIn-b2bJErsLaNyN-n57ZZdNdhyTq2MaKgcfGaCCTeI1-CyubNJ9_wc1MqjISiEOAnYkKU2hnbyE_qmievwLvAH1QhR78Nz7eCc Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f97dff96032f4f2193acabe74c8b69bd Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f97dff96032f4f2193acabe74c8b69bd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f97dff96032f4f2193acabe74c8b69bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f97dff96032f4f2193acabe74c8b69bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f97dff96032f4f2193acabe74c8b69bd"}]}] Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f97dff96032f4f2193acabe74c8b69bd Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1126547122 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FloatingIPsNegativeTestJSON-1126547122-project Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 480ecf0ebd274b5aa533822f4672dd00 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1126547122-project Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: exception: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '533dba6e-0b2a-434f-b9d9-83b50f605b7c'} Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 533dba6e-0b2a-434f-b9d9-83b50f605b7c could not be found Nov 02 12:39:03.666278 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-79c3b652-809f-4a5f-89ec-e645e4406c3e'] Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c. Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c Nov 02 12:39:03.670732 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:39:03.678019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] Returning 404 to user: Floating IP not found for ID 533dba6e-0b2a-434f-b9d9-83b50f605b7c {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:03.679356 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d8527f6-3372-4e96-9076-0cdb3fe79040 tempest-FloatingIPsNegativeTestJSON-1126547122 tempest-FloatingIPsNegativeTestJSON-1126547122-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/533dba6e-0b2a-434f-b9d9-83b50f605b7c" status: 404 len: 111 microversion: 2.1 time: 0.139124 Nov 02 12:39:03.685382 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 497/960] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:39:03 2022] DELETE /compute/v2.1/os-floating-ips/533dba6e-0b2a-434f-b9d9-83b50f605b7c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:03.703551 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:03.714934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:03.735437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.736341 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.736977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.740116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.742169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.745473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.927305 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.927936 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.928480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.929326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:03.930018 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:03.930699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:03.950173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:03.951283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:03.951836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:03.952601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:03.953252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:03.954648 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:03.965358 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-705b05b6-5f0e-4e1a-aa2d-b5b1254b7aa2 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064/detail" status: 200 len: 463 microversion: 2.57 time: 0.662458 Nov 02 12:39:03.970648 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 464/961] 10.222.0.64 () {60 vars in 1304 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064/detail => generated 463 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:03.982525 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5da79e01-981e-44dc-b58b-458e8ea960d0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5ce47310>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:04.091645 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5da79e01-981e-44dc-b58b-458e8ea960d0 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.117959 Nov 02 12:39:04.094735 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 465/962] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:03 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:04.157027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:04.158263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:04.168795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.169965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.170785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.172522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.173209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.173816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.322300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:04.614254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:04.628511 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.629583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.630400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.631412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:04.632289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:04.633581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:04.960471 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:04.970044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:04.980742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:04.992751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.027297 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ae7f24a4-8352-4543-9fd9-44a4c7188bbe tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "POST /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86/action" status: 202 len: 1494 microversion: 2.75 time: 1.339451 Nov 02 12:39:05.028925 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 498/963] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:39:03 2022] POST /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86/action => generated 1494 bytes in 1343 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:39:05.055443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.058709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:05.067596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.069396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.080578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.086840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.089238 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.092915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.093691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.105468 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cc0586e6-c9c4-499b-8ac7-ee342019f3ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.952944 Nov 02 12:39:05.108801 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 466/964] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:04 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:05.119231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Action: 'update', calling method: .version_select at 0x7eff5ccb6b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:05.264823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.265318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.270720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.274006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.274006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.274006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.336121 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.336775 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.338249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.361784 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.363653 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.364398 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.403417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.413272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.415575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.423691 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a3e72f87-5833-48d6-95d8-3878ea363022 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.393383 Nov 02 12:39:05.426797 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 499/965] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:05.458731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.459555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:05.467598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.472789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.473886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.474991 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:05.475715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:05.476677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:05.601623 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4b00b44d-8174-428b-a44a-cfcd441e8e6c tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064?user_id=1e45a631b48045f18178bd56e24c4d09" status: 200 len: 148 microversion: 2.57 time: 0.488690 Nov 02 12:39:05.603132 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 467/966] 10.222.0.64 () {62 vars in 1384 bytes} [Wed Nov 2 12:39:05 2022] PUT /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064?user_id=1e45a631b48045f18178bd56e24c4d09 => generated 148 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:05.616721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8806ceeb-7c13-4939-8d11-7c5f5925dccb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4f85e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.668572 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.694101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.700279 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8806ceeb-7c13-4939-8d11-7c5f5925dccb tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.095617 Nov 02 12:39:05.712538 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 468/967] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:05.712780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:05.712902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a883c1d7-0bae-4549-8655-eb657938ff74 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] Calling method '.version_select at 0x7eff5d434a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:05.714918 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-53960f03-ad46-4b20-abce-65b6b0ddcc38 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.286544 Nov 02 12:39:05.735692 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 500/968] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:05.879945 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a883c1d7-0bae-4549-8655-eb657938ff74 tempest-QuotasAdminTestV257-821241151 tempest-QuotasAdminTestV257-821241151-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064?user_id=1e45a631b48045f18178bd56e24c4d09" status: 200 len: 190 microversion: 2.57 time: 0.177465 Nov 02 12:39:05.881395 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 469/969] 10.222.0.64 () {60 vars in 1364 bytes} [Wed Nov 2 12:39:05 2022] GET /compute/v2.1/os-quota-sets/601d393c87754946839c535642f5e064?user_id=1e45a631b48045f18178bd56e24c4d09 => generated 190 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:39:06.132554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.133197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.147810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.154096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.154559 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.159253 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.161011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.164085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.165540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:06.454446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:06.455309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:06.465501 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.467701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.468365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:06.470308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:06.471028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:06.471633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.218796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.250033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.254798 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.266113 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0a2a92c1-5ec3-4293-a445-cb6a0dc25661 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.815853 Nov 02 12:39:07.269909 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 470/970] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:07.287900 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80dfbddd-6307-49e2-b59d-12e38ab6941b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5ce474c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:07.388411 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-80dfbddd-6307-49e2-b59d-12e38ab6941b tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.114557 Nov 02 12:39:07.389832 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 471/971] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:07 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.396796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:07.397423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:07.421153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:07.424838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:07.425715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.431560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:07.432413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:07.433523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:07.458882 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:07.874503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.901700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.923655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.931841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:07.959086 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-129eecf4-c2cc-4835-8283-414a3d15036e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 1.831268 Nov 02 12:39:07.984686 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 501/972] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:06 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:07.998228 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fa196b74-ec1b-46d1-9564-64ee42b98c79 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.606276 Nov 02 12:39:08.006212 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 472/973] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:07 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:08.335299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.339502 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:08.370138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.376516 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.379036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.400392 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:08.420869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-05c242d6-65f1-4a76-84d1-0396e3dd37cf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c7268b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:08.450183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:08.451799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:08.559048 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-05c242d6-65f1-4a76-84d1-0396e3dd37cf tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.151387 Nov 02 12:39:08.563248 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 473/974] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:08.984104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.007037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.007728 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.008358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:09.009772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.018250 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4b741dd2-6bf9-4e77-8446-a84fae57efcd tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.696544 Nov 02 12:39:09.019888 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 502/975] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:08 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:09.022087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.024752 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.025452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.026411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.028617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.030807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.057852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.058794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:09.068428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.070218 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.072321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.073092 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:09.077906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:09.080409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:09.543937 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.559422 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.563099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:09.575708 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-89372d62-fd5e-4789-9000-49546325d7f0 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.520724 Nov 02 12:39:09.592384 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 503/976] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:09 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:09.592384 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-774be5d7-7f95-4927-aeba-deabb534b6b2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c605af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:09.679809 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-774be5d7-7f95-4927-aeba-deabb534b6b2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.095821 Nov 02 12:39:09.680425 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 504/977] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:09 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.049548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.050298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.070766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.073130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.073840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.075755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.078632 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.079013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.402621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.417537 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0e42c1dc-5ea9-4bf5-b2d0-808daa2a4e31 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 1.413570 Nov 02 12:39:10.428808 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 474/978] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:09 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:10.458380 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.472752 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.478235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.489599 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66e48ad5-bdd9-496f-89d2-cf789f30020e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1537 microversion: 2.91 time: 0.441998 Nov 02 12:39:10.490749 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 505/979] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1537 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:10.616685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.616685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:10.622296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.622793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.623235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.623959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.644286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.644837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.696899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-42b0d95c-eb11-4bb7-91bc-4b436d68ce73 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4b61f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:10.800793 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-42b0d95c-eb11-4bb7-91bc-4b436d68ce73 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.108533 Nov 02 12:39:10.801652 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 506/980] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:10.817743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48de1b1f-9d7e-41bf-b1e6-023d17cecc0e", "tag": "3d81e47f-bfd3-4fb1-86b4-cc02113a5157"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:10.838151 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:10.838918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:10.840128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:10.853417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.854123 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] Creating event network-changed:3d81e47f-bfd3-4fb1-86b4-cc02113a5157 for instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e on n-h2-857339-6 Nov 02 12:39:10.859952 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-53841582-a487-4547-81ca-4b6cd68c2724 req-0da9ceb7-f1f4-495c-a467-3224c773af57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056813 Nov 02 12:39:10.860961 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 507/981] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:10.878927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.881663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:10.903848 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-23c183e8-da2b-46be-b2f6-a9f351786f28 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.293041 Nov 02 12:39:10.905247 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 475/982] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:10 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:11.444083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.445497 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:11.464795 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.465219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.465658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.466378 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.470614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.471054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.526923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.527828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:11.544714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.548223 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.548896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.549887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:11.550622 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:11.552185 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:11.763247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:11.781970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:11.786481 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:11.799397 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-02206b62-b660-40e0-ad76-431e8432304f tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1558 microversion: 2.91 time: 0.283890 Nov 02 12:39:11.836295 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 476/983] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1558 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:11.839433 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-321c0dbf-e623-4813-9dc7-3ab023298938 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4adf70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.942827 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-321c0dbf-e623-4813-9dc7-3ab023298938 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.120650 Nov 02 12:39:11.947444 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 477/984] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:11.979723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:11.988867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:12.018891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.020807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.022230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.029701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.032002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.032692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.131013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.147858 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e8b08d8c-bd28-4650-8bd6-d88ae988a977 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.708368 Nov 02 12:39:12.151662 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 508/985] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:12.343926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.366324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.369292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:12.390127 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-44582819-fe5f-47a9-8b9d-ac01ef04eb93 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.441315 Nov 02 12:39:12.405693 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 478/986] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:11 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:12.861821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:12.863904 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:12.913394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:12.962208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ed1489e-5218-44e8-800f-566ccd837544 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c5c2ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:13.075314 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0ed1489e-5218-44e8-800f-566ccd837544 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.106476 Nov 02 12:39:13.075314 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 479/987] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:12 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:13.152638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.170833 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.175828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:13.176461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:13.177821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.191734 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.192237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.192715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.193438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.193895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.194323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.213923 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e5b6903-d9b1-4cc4-be02-a7a81d1d7a28 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1558 microversion: 2.91 time: 0.374550 Nov 02 12:39:13.217336 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 509/988] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:12 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1558 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:13.441431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:13.444431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:13.459255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.460540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.461460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.463475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:13.464397 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:13.466079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:13.556603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.569045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.571435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.578101 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-91c97805-4960-44f9-bebd-b0c1ea9ce01a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.157980 Nov 02 12:39:13.579008 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 510/989] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:13 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:13.587274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:13.601435 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-68f3c171-a036-40b5-b972-c2195a914281 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.429854 Nov 02 12:39:13.602118 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 480/990] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:13 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:14.089089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bc1b3b69-416a-46b6-a08f-57d4a405705c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c6054c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.249542 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.251025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.274227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.276947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.277374 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.283028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.302099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.304271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.517282 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bc1b3b69-416a-46b6-a08f-57d4a405705c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1421 microversion: 2.1 time: 0.432412 Nov 02 12:39:14.533847 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 511/991] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1421 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:14.614989 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.615850 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.636274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.641842 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.644123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.654311 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.658166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.661098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.813761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:14.829329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:14.841925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:14.860711 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cdc5ad00-807a-4716-ab34-e810466b6623 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.620030 Nov 02 12:39:14.868477 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 481/992] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:39:14.880996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:14.896800 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:14.924264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.930679 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.931673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:14.933901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:14.935054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:14.937408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.053400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.079890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.093818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.120665 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-165e547f-3fc6-4832-ad0c-db3cd010df16 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.512060 Nov 02 12:39:15.131088 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 512/993] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:15.394751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=13 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:15.405719 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:15.442184 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-648b3d0b-73a2-4255-aa96-1f0c749d46f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.565452 Nov 02 12:39:15.445026 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 482/994] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:14 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:15.551675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee8f0ec9-2b80-4808-91eb-82cdca4038d7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4b6f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:15.947381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:15.950303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:15.976701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=36 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:15.984168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.988614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.989643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:15.993699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:15.996543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:15.998901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.219407 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.245175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.248716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.291835 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0461eebb-2fb0-4d88-b385-195e82c71ab8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.356508 Nov 02 12:39:16.306268 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 483/995] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:15 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:16.359727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:16.361564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:16.376621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.378655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.379613 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.381212 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.382342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.383242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.554154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.564632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.571705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:16.591405 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-239424db-b196-4821-89b3-a79d90c3e4f6 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.283168 Nov 02 12:39:16.600056 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 484/996] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:16 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:16.605534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:16.622092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:16.671828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.677244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.677959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:16.679154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:16.681283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:16.681971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.095988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.166869 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-430d2648-8672-4e7d-acd7-fdbae07637ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.564750 Nov 02 12:39:17.174631 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 485/997] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:16 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:17.367630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:17.369135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:17.413448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.414831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.415858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.417676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:17.423299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:17.425153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:17.820933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.899578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.905676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:17.925135 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4869fdd9-f807-46c9-ace4-ca354b667567 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.566668 Nov 02 12:39:17.948477 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 486/998] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:17 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:17.971851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:17.978176 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:18.004131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.006786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.008959 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.011575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.014598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.015321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.208958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:18.220143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:18.238452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:18.268042 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a59998f3-966b-4626-b6e4-74887bb63977 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.320923 Nov 02 12:39:18.272547 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 487/999] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:17 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:18.345397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:18.347054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:18.406498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.407389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.408205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:18.409671 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:18.449688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:18.450498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:19.971212 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:19.992909 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-31a88909-3f41-4d71-b4d3-49626180da14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 1.688879 Nov 02 12:39:19.992909 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 488/1000] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:18 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:20.986003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-328239269", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:24.164154 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ee8f0ec9-2b80-4808-91eb-82cdca4038d7 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1430 microversion: 2.1 time: 8.623321 Nov 02 12:39:24.193236 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 513/1001] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:15 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1430 bytes in 8654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:24.213979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:24.224256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:24.235178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:24.277009 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.279986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.280739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.282088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.287882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.289595 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.830411 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:24.853102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:24.856856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:24.864243 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a7c06af6-d873-40d3-8917-32f5fd53ac49 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.667962 Nov 02 12:39:24.873956 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 514/1002] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:24 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:24.880639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:24.887592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:24.899623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.900276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.901037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.902082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.902789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.903810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.934928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:24.936635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:24.937388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:24.937971 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:24.938535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:24.950916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.951678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.953101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:24.954439 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:24.955082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:24.957282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.032050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Getting quotas for project d4fefce7b59b4135ab03a518f381e171. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:25.045064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Getting quotas for user 10f57760d0b5468b91c7b9666305dba9 and project d4fefce7b59b4135ab03a518f381e171. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:25.078313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:25.082221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:25.195053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:25.286772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.302746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.309769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:25.326914 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-88d46628-510f-4206-a0d8-fbc7d1c7c33a tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.450714 Nov 02 12:39:25.328113 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f5ee9736-dbc8-4a5c-8861-22079b2fed28 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.325633 Nov 02 12:39:25.333650 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 515/1003] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:24 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:25.353252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48de1b1f-9d7e-41bf-b1e6-023d17cecc0e", "name": "network-vif-plugged", "status": "completed", "tag": "3d81e47f-bfd3-4fb1-86b4-cc02113a5157"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:25.354294 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 489/1004] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 5365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:39:25.368354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:25.370304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:25.372251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:25.375503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:25.377827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.386561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:25.387799 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:25.390257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.392808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:25.394299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:25.397474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:25.411701 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] Creating event network-vif-plugged:3d81e47f-bfd3-4fb1-86b4-cc02113a5157 for instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e on n-h2-857339-6 Nov 02 12:39:25.430749 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-9aed00a9-a8f9-4316-87c4-483ab5b8b390 req-1a8bda08-bcf3-4523-9b93-c7b78c513e24 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094728 Nov 02 12:39:25.431651 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 516/1005] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:25.469271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fe657ee6-31d8-4f87-9824-6df7afc1095d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4c9af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:25.653510 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fe657ee6-31d8-4f87-9824-6df7afc1095d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 200 len: 1430 microversion: 2.1 time: 0.199403 Nov 02 12:39:25.663827 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 517/1006] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:25 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 1430 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:25.683457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-48605267-8793-45d7-876a-dc83cd6026ac tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:25.686567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-48605267-8793-45d7-876a-dc83cd6026ac tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.076013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-48605267-8793-45d7-876a-dc83cd6026ac tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:26.104323 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-48605267-8793-45d7-876a-dc83cd6026ac tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1221 microversion: 2.1 time: 0.438377 Nov 02 12:39:26.111258 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 518/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:25 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1221 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:26.152591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.152591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.185920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.195250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.195915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.197832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.198376 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.201019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.572828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:26.592671 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b4f7ecc2-d983-4b40-932c-86646b733043 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1466 microversion: 2.1 time: 0.471868 Nov 02 12:39:26.601487 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 519/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1466 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:26.618592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.624369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.649666 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.656184 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.660223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.661398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.661908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.668421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.678410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:26.712123 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-08611221-3f21-45e9-8038-fe3f00b76cd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 1.356095 Nov 02 12:39:26.713960 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 490/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:25 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:26.742772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:26.744382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:26.795296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.795839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.798817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:26.804793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:26.806322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:26.808444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:27.058125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.067809 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.078701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.101803 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fe156cc8-7e76-41f9-9965-7b8d5efbf33e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.503939 Nov 02 12:39:27.110497 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 520/1010] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:27.127060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3f1cafe4-6aa8-4c01-bbd3-f7157eef8bac tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4c9940>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.192182 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3f1cafe4-6aa8-4c01-bbd3-f7157eef8bac tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067" status: 200 len: 784 microversion: 2.1 time: 0.079508 Nov 02 12:39:27.194058 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 521/1011] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067 => generated 784 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:27.201153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cb81995c-9f2b-46ed-8953-a273f8570879 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.205081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cb81995c-9f2b-46ed-8953-a273f8570879 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:27.276388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.301173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.312098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.316771 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cb81995c-9f2b-46ed-8953-a273f8570879 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:27.337043 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cb81995c-9f2b-46ed-8953-a273f8570879 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1221 microversion: 2.1 time: 0.133352 Nov 02 12:39:27.337043 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 522/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:27.345090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d30f2b2-4e95-4fa2-b0ad-8b93e40bbf4c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.347070 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-443ced0f-7975-4ed1-8e03-86a601807f3b tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.631016 Nov 02 12:39:27.347711 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 491/1013] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:26 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:27.359623 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d30f2b2-4e95-4fa2-b0ad-8b93e40bbf4c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022155 Nov 02 12:39:27.359623 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 523/1014] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:27.400645 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-571ea109-5a78-49f3-bf66-14339aa72903 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5cd4b040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.634262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ee232b7-1cdf-4826-8881-1a384ff2c7b7 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Action: 'create', calling method: .version_select at 0x7eff5c559280>, body: {"keypair": {"name": "tempest-keypair-1704113207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFz4l3JVEg6D5Bggl7K6oOJGL+9Bq12jE8TZc+FwVOm4rbVdNfmvAXH4U4mxdhEzps0oaA2HK1bcNqC2MMOW93EB3CtcBaw2S4pZbyo3/Xez1CK8oihrXwVJe/vmlxXOg=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:27.686443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-6ee232b7-1cdf-4826-8881-1a384ff2c7b7 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Getting quotas for project f871d4dccfa64340ae699fe84bb10a79. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:27.699535 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-6ee232b7-1cdf-4826-8881-1a384ff2c7b7 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Getting quotas for user 99582f1c239d4209a1909c5a849de953 and project f871d4dccfa64340ae699fe84bb10a79. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:27.748645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:27.856899 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6ee232b7-1cdf-4826-8881-1a384ff2c7b7 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.496660 Nov 02 12:39:27.858290 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 524/1015] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:39:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:27.865805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:27.868023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:27.896371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.897150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.897709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:27.901583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:27.902090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:27.902538 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.530133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.539374 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e514379f-fcf2-4b72-9a0f-27cd860e16d3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1317 microversion: 2.1 time: 0.679851 Nov 02 12:39:28.562371 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 525/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:27 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:28.572846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:28.577204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:28.592265 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.593783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.595991 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.598424 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.601282 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.601943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.761465 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.769811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:28.777720 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.780901 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:28.801118 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6e7ac2ee-c111-49e7-aa26-185fa51dfb61 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.233103 Nov 02 12:39:28.806697 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 526/1017] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:28 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:28.810846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:28.811768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:28.826994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.830086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.830904 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:28.831894 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:28.836354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:28.843045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.018408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.030650 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5ba98bfd-2f9e-4618-9936-514bbc34fe08 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1217 microversion: 2.1 time: 0.227180 Nov 02 12:39:29.037365 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 527/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:28 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1217 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:29.052785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.058086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.081007 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.082879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.089697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.091623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.094686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.095715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.427864 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.444695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.450050 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:29.472920 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a5656f78-825a-491a-8f93-5ba047671bdc tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.427004 Nov 02 12:39:29.491401 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 528/1019] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:29.570334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.571272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.590513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.598022 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.604075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.604979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.605455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.615157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.735561 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-571ea109-5a78-49f3-bf66-14339aa72903 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "DELETE /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 204 len: 0 microversion: 2.1 time: 2.346845 Nov 02 12:39:29.740552 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 492/1020] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:27 2022] DELETE /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 0 bytes in 2350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:29.757720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c48d8cca-72a0-4db4-9091-5d32bdd9fd1d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c6f54c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:29.794471 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-c48d8cca-72a0-4db4-9091-5d32bdd9fd1d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] HTTP exception thrown: Image not found. Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c48d8cca-72a0-4db4-9091-5d32bdd9fd1d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Request method failure captured: Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 HTTP/1.1 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTB8h78vMr4OgpxOFurLEeIgue_KinfJ5h3-kBSqg-eUEOSrE24UcwqEj9S5wP7F2u83lMj2hKnJ2kMn2psEvhvYjzhiatvp3dyvZ_hkJsrlqUVznhypO7LsINOCrEXk1OWEe0EGeakOLzizMooia5NuKUbcyUIBoij9Cv5p5Fj0Fs Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_607346d5cd14420f930647ff1ecdb94d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}] Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 63589f909a744bf1afec7d1f2e659f8a Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '7a3a0d13-1a0f-4d66-b9db-b447db936087'} Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a3a0d13-1a0f-4d66-b9db-b447db936087 Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:39:29.796799 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a3a0d13-1a0f-4d66-b9db-b447db936087 could not be found. Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c48d8cca-72a0-4db4-9091-5d32bdd9fd1d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c48d8cca-72a0-4db4-9091-5d32bdd9fd1d tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 404 len: 62 microversion: 2.1 time: 0.056854 Nov 02 12:39:29.804419 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 493/1021] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:39:29.817376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-395889605"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:29.821418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:29.843643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.844274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.844877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.847520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:29.848109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:29.850917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:29.904536 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:30.041878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.057004 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-272ea94c-3fae-4fd0-884d-9bd0e1959343 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1467 microversion: 2.1 time: 0.491745 Nov 02 12:39:30.080870 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 529/1022] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:29 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1467 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:30.089534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:30.096898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:30.111240 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.116410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.117141 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.118161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.118846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.119490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.390333 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.411280 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.420811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.443397 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-33de8756-faeb-4c2a-be77-9ace77245b82 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.361163 Nov 02 12:39:30.448237 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 530/1023] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:30.467735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:30.472913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:30.495318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.508416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.512880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.513831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.514566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.515092 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.668032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:30.679559 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-91c23874-d9a0-48ed-8fe7-2008f95b47d6 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1281 microversion: 2.1 time: 0.230122 Nov 02 12:39:30.680889 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 531/1024] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:30.717232 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-661a961a-24a1-4101-8cfc-91c1a65aee03 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "POST /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73/action" status: 202 len: 0 microversion: 2.1 time: 0.904644 Nov 02 12:39:30.719221 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 494/1025] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:39:29 2022] POST /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 02 12:39:30.730519 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:30.731513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:30.742054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.744675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.745359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:30.748141 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:30.748921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:30.749732 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.139343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.143261 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:31.147566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:31.168531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.177652 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.182844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.183661 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.184150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:31.192687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.194049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.198267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.274124 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-908653e0-30b0-4582-b670-96b7ea79560f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1446 microversion: 2.75 time: 0.537358 Nov 02 12:39:31.274124 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 495/1026] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1446 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:31.308213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:31.414987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.420003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.422763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.504474 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] Creating event network-vif-unplugged:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:39:31.527067 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-d67da640-ee6b-4d6a-a4d4-766df31ce55e req-e60c3953-c2b4-48aa-82e5-dde01713c496 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.265893 Nov 02 12:39:31.529609 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 496/1027] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:31.555582 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e7cf7071-a1b5-42a2-84b1-b3dcf953b6d6 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c6f5430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:31.704338 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e7cf7071-a1b5-42a2-84b1-b3dcf953b6d6 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 200 len: 1426 microversion: 2.1 time: 0.171053 Nov 02 12:39:31.705008 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 497/1028] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:31 2022] GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 1426 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:31.734300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:31.735593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:31.771968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.780690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.782850 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:31.784576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:31.795076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:31.795990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.726743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:32.749247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:32.760296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:32.802275 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d3f957a9-7b8c-4619-9048-bee5459c5954 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 1.091773 Nov 02 12:39:32.804582 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 498/1029] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:31 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:32.818272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:32.821440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:32.855021 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.855750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.857630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:32.859746 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:32.860887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:32.861658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:33.353904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:33.398453 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ad9cd8b7-0f96-4e09-9feb-95f91219a1fa tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1279 microversion: 2.1 time: 0.592262 Nov 02 12:39:33.403019 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 499/1030] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:32 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1279 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:33.425016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:33.427029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:33.444961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:33.457022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:33.474242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:33.479343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:33.481561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:33.483569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.086113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:34.105272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:34.114231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:34.135318 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2cfaa00a-e54a-4148-af41-72160d29016d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1452 microversion: 2.75 time: 0.730289 Nov 02 12:39:34.140145 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 500/1031] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:33 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1452 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:34.157168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-37049c18-9aab-4e65-9362-76f244f3a0a4 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5e454ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:34.280434 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-37049c18-9aab-4e65-9362-76f244f3a0a4 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 200 len: 1426 microversion: 2.1 time: 0.135051 Nov 02 12:39:34.287469 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 501/1032] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:34 2022] GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:34.596418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-502595398", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "8bad8c5f-d664-4f1c-bad4-6fda0d75c22d"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:34.834652 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] validate_networks() for [('8bad8c5f-d664-4f1c-bad4-6fda0d75c22d', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:35.002460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:35.058969 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:35.548652 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3844b38e-bd65-4049-a528-a411c10db3bf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1618 microversion: 2.1 time: 4.848922 Nov 02 12:39:35.548652 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 532/1033] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:30 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1618 bytes in 4851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:35.560432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.566437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.578384 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.579668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.580440 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.581527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.582367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.583962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.903056 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.912503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.913995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:35.932046 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d9e57f3-77a7-4860-a693-36e82b9521c8 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.397497 Nov 02 12:39:35.936264 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 533/1034] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:35.957407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:35.958695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:35.970760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.977164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.977164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:35.977164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:35.977164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:35.977164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-584a62fb-ff1e-4369-981d-79b1eba52bdd) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:39:36.106150 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-584a62fb-ff1e-4369-981d-79b1eba52bdd) Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:36.110741 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] Request method failure captured: Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 212 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmUFMybRtiQj4ZJuEha2viuJz-xZ1x8YpMu_mIBbjLwNMPMRHZ6ijy2ge1YwgSqYGXvqqsgroOu8VETRKKn-22NBzWdsNLgyWTVaIWZDdnBHgQHB0Kciuics_8lnSGBrprtiEtLtT2CxkEEJcGiYW28-MPVI8-Wz2gcDrgraW8KjQW4 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.21 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 39d655a565644746a2d466d88fa00f02 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1191953179 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_39d655a565644746a2d466d88fa00f02", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/39d655a565644746a2d466d88fa00f02"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/39d655a565644746a2d466d88fa00f02"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/39d655a565644746a2d466d88fa00f02"}]}] Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-InstanceActionsV221TestJSON-1191953179 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 39d655a565644746a2d466d88fa00f02 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1191953179 Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-InstanceActionsV221TestJSON-1191953179-project Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b276ebf583404e61b5f57e00f11caa0f Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-InstanceActionsV221TestJSON-1191953179-project Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-502595398", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "8bad8c5f-d664-4f1c-bad4-6fda0d75c22d"}]}} Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsV221TestJSON-server-502595398', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '8bad8c5f-d664-4f1c-bad4-6fda0d75c22d'}]}}} Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:39:36.112274 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-584a62fb-ff1e-4369-981d-79b1eba52bdd) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:39:36.119292 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.124095 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:36.125241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:36.125241 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:36.126571 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9ea28ad9-5645-4d58-a2fc-3984b4ce19c3 tempest-InstanceActionsV221TestJSON-1191953179 tempest-InstanceActionsV221TestJSON-1191953179-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.21 time: 1.836615 Nov 02 12:39:36.141220 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 502/1035] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:39:34 2022] POST /compute/v2.1/servers => generated 214 bytes in 1853 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:39:36.151839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:36.156942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:36.174671 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.182033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.182662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.184340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.185334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.185955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.885949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:36.934411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:36.961780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:36.988052 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-890dcc18-7701-40eb-a637-b12aeef582f1 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1452 microversion: 2.75 time: 0.842617 Nov 02 12:39:37.006745 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 503/1036] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:36 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1452 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:37.009629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.020921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3348a82f-459f-4f8a-864b-357cf899440c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c47faf0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:37.030494 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6b1a381f-3ca7-416f-9e31-219c9d540389 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1321 microversion: 2.1 time: 1.088582 Nov 02 12:39:37.046902 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 534/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:35 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1321 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:37.065484 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: .version_select at 0x7eff5c476ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-19609557", "policies": ["affinity"]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:37.132065 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:37.153129 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:37.421086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:37.441489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:37.504363 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a9daaa3a-9597-4e88-83a0-b2a12fb2e65c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.449855 Nov 02 12:39:37.507741 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 535/1038] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:39:37 2022] POST /compute/v2.1/os-server-groups => generated 186 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:37.529791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:37.530412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:37.550237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:37.551159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:37.554636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:37.554636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:37.554636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:37.554636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:37.804707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.850947 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.864876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:37.905556 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ac09e9ab-2ecd-4c19-9843-670552a8b992 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1553 microversion: 2.91 time: 0.392000 Nov 02 12:39:37.911238 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 536/1039] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:37 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1553 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:37.932334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1676756953", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "7921c2e9-6367-409a-bc86-1be87e9441ad"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:46.907292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:46.986445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=30 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:47.052175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:39:47.069395 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3348a82f-459f-4f8a-864b-357cf899440c tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 200 len: 1426 microversion: 2.1 time: 10.048679 Nov 02 12:39:47.069395 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 504/1040] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:37 2022] GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 1426 bytes in 10053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:47.078679 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.079535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.097981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.098493 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.098944 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.099773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.109625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.109625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.453695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.481521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=16 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:47.499328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.510098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.535968 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-24f3c71a-f814-4dc3-a786-e07fd2ff228d tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1437 microversion: 2.75 time: 0.474486 Nov 02 12:39:47.541275 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 505/1041] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1437 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:47.561918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.562559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.584448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.585109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.585571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.586418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.586930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.587448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.826657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=55 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:48.003931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=59 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:48.403980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.417880 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-41fb48c0-44ce-4bfb-93f8-2843654cf459 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1321 microversion: 2.1 time: 0.871903 Nov 02 12:39:48.432063 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 506/1042] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1321 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:48.432063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.432063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:48.442937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.443532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.443992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.444780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.445253 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.445796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.555274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:48.555833 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:48.556313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:48.556777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:48.560439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:48.652970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.653810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.655324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.657105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.661688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.661688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.700538 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:48.710322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:48.724817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.737102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 2 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:39:48.739679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:48.747947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.759617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:48.775803 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7032c838-f2b6-4916-93c1-79af7aa955ee tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1535 microversion: 2.91 time: 0.355627 Nov 02 12:39:48.811958 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 507/1043] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:48 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1535 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:48.824626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ea316b7-8375-4c4b-b84a-73ba6b2f40f3", "tag": "d52229ec-7865-402d-84bb-7a7568d392fd"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:48.847540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.848349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.849133 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.871570 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] Creating event network-changed:d52229ec-7865-402d-84bb-7a7568d392fd for instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 on n-h1-857339-6 Nov 02 12:39:48.880644 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-125e0eb0-1f0a-49b5-932c-2b4e32ac3007 req-6b394f6c-f9cc-4dbb-b03f-bb7256de4966 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066828 Nov 02 12:39:48.881985 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 508/1044] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:48.892523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-plugged", "status": "completed", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:48.911221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.912215 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.913043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.937956 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] Creating event network-vif-plugged:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:39:48.947764 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-9a1aa64a-d7d7-4e43-82cd-70af3a3b4bd1 req-d938f3b8-65f7-4ce6-87c8-9bbf4d54ab50 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061881 Nov 02 12:39:48.949270 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 509/1045] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:48.989432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=127767) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Nov 02 12:39:49.070723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:49.096532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:49.238145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:49.256373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:49.287908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.290530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.292986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.302980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:49.302980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:49.302980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:49.303613 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:49.310962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:49.333533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=d03b43bf-3491-4c06-8be8-6f70f679d53f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:39:49.611177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:49.630776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:49.632703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:39:49.648055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:39:49.648548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:39:49.648859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:39:49.649410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:39:49.871926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:39:49.891708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:39:50.005765 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e2ac850a-4121-4890-adb8-30d0f01252b3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 12.086894 Nov 02 12:39:50.006790 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 537/1046] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:39:37 2022] POST /compute/v2.1/servers => generated 32 bytes in 12094 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:39:50.035405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a3391f54-1ed4-4b38-ac10-d16f5ab75b79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c4c9790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.121877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.147460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.147952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.148574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.149318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.149783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.150216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.559750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:50.660443 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4f17e1f0-da25-467b-a959-513be0795d82 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86/action" status: 202 len: 1940 microversion: 2.75 time: 1.709449 Nov 02 12:39:50.668736 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 510/1047] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:39:48 2022] POST /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86/action => generated 1940 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:39:50.935003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] Calling method '.version_select at 0x7eff5ce47310>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.232643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ee43199b-aa4c-4543-aa15-5d9c425b3de6 could not be found", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:39:51.237218 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] HTTP exception thrown: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] Request method failure captured: Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-floating-ips/ee43199b-aa4c-4543-aa15-5d9c425b3de6 HTTP/1.1 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmUVPb7Y-HZGX5AmKPaKoblLO1AjpbATNM13lEwGiBs2IEPGr_TlT2An6HL3boN6qvJgrifIE1qUzs0xZregpEmBTpa9u5I7tYBiCk4kHtDzLF1SH9KhlBFvFap7I06aI6FYQmaSGP45WCR2NZHTZfnrgI3oyV39zkOXN40Bp6Ym3aI Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 48947c2a4f894d61863e6fc08f77f410 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-551680987 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_48947c2a4f894d61863e6fc08f77f410", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/48947c2a4f894d61863e6fc08f77f410"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/48947c2a4f894d61863e6fc08f77f410"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/48947c2a4f894d61863e6fc08f77f410"}]}] Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-551680987 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 48947c2a4f894d61863e6fc08f77f410 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-551680987 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-551680987-project Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7447ac1c4d694633930d75276c56b8c3 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-551680987-project Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: exception: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'ee43199b-aa4c-4543-aa15-5d9c425b3de6'} Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ee43199b-aa4c-4543-aa15-5d9c425b3de6 could not be found Nov 02 12:39:51.245025 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de873105-3110-4065-8013-e643fd5918ee'] Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6. Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6 Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6 Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] Returning 404 to user: Floating IP not found for ID ee43199b-aa4c-4543-aa15-5d9c425b3de6 {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aeba60af-b3e5-456e-8b98-576424f21a60 tempest-FloatingIPDetailsNegativeTestJSON-551680987 tempest-FloatingIPDetailsNegativeTestJSON-551680987-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips/ee43199b-aa4c-4543-aa15-5d9c425b3de6" status: 404 len: 111 microversion: 2.1 time: 0.574496 Nov 02 12:39:51.259984 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 511/1048] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/os-floating-ips/ee43199b-aa4c-4543-aa15-5d9c425b3de6 => generated 111 bytes in 578 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:51.296466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.317154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.366429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.382905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.385371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.386879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.394321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.396687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.054817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.084130 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0876f6c4-875d-4a32-b675-eafb7f9feaa3 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1321 microversion: 2.1 time: 0.833372 Nov 02 12:39:52.088470 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 512/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:51 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1321 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:52.093780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.107060 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.122956 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.123673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.127120 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.141118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.141859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.142351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.308066 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.318993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.320477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebf0681a98044ce29352cc8abdaa69f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0aa9b18c154964972a8c57c290dfe0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.366434 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3dc5f8ed-d040-4fe4-8bc9-df1901a116f2 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 200 len: 1478 microversion: 2.91 time: 0.276616 Nov 02 12:39:52.367455 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 513/1050] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 1478 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:52.389534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.404869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:52.417024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Searching by: {'deleted': False, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4'} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:39:52.454791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.465365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.465365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.465365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.465365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.465365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.650343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.multi_cell_list [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127766) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:39:52.763724 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3fac6020-5703-40d2-91ac-b8e312ed85ff tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.394098 Nov 02 12:39:52.765290 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 514/1051] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers => generated 1004 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:52.772346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.774459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.788016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.789502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.790254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.791436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.792153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.792918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.941691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:52.970912 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57dd2892-6f4a-4e35-89b7-a449586d9d2e tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.203450 Nov 02 12:39:52.972240 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 515/1052] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:39:52.978305 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea316b7-8375-4c4b-b84a-73ba6b2f40f3", "name": "network-vif-plugged", "status": "completed", "tag": "d52229ec-7865-402d-84bb-7a7568d392fd"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:52.989505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.995404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.996212 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.018461 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] Creating event network-vif-plugged:d52229ec-7865-402d-84bb-7a7568d392fd for instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 on n-h1-857339-6 Nov 02 12:39:53.024250 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-c3449b75-cb0c-4184-8a0b-c68bae53c9b1 req-f40d18cd-75e0-4a5d-b8b5-cafec613adda service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050108 Nov 02 12:39:53.025296 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 516/1053] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:53.037250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:53.044471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:53.050565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.051451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.056451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.057931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.058811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.059344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:39:53.120702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f) Nov 02 12:39:53.125091 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.130815 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:53.130815 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Request method failure captured: Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0/action HTTP/1.1 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 39 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTCDPT1kbhAPiOdCKmOxJwX7EZLMzRopfpU8aC-QEJg-o5FbrOy74_9IqopR5r_RtB4hWKGEeeH7TNhO570h7kK6LIFuK-phFRhpQg5pSJ2RGwjiLGKzjo9MmpEQyUXu9pBiN16wSqOzmWo-xkxtQ5dekvICsHhG4WHfy7DEllsYLU Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3d5db113d0f54d428c263c1631f577cc Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-2013429481 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3d5db113d0f54d428c263c1631f577cc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d5db113d0f54d428c263c1631f577cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3d5db113d0f54d428c263c1631f577cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d5db113d0f54d428c263c1631f577cc"}]}] Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-2013429481 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3d5db113d0f54d428c263c1631f577cc Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-2013429481 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: bc06d014dd654ea4bc0c11c08067f625 Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: {"unshelve": {"host": "n-h1-857339-6"}} Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'f81c86aa-9de1-4bea-85c4-3998aea902e0', 'body': {'unshelve': {'host': 'n-h1-857339-6'}}} Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.134180 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf9e8d8b-1b29-41a7-b95d-16552e3f5c9f) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:53.149728 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7e75dc36-587e-412c-bf43-5ee3070f99bb tempest-UnshelveToHostMultiNodesTest-2013429481 tempest-UnshelveToHostMultiNodesTest-2013429481-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0/action" status: 500 len: 214 microversion: 2.91 time: 0.106059 Nov 02 12:39:53.153496 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 517/1054] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:39:53 2022] POST /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0/action => generated 214 bytes in 110 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:39:53.158824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-41608a62-c673-4a40-9c60-c1adc7753648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:53.162918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-41608a62-c673-4a40-9c60-c1adc7753648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:53.579949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-41608a62-c673-4a40-9c60-c1adc7753648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:53.622599 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-41608a62-c673-4a40-9c60-c1adc7753648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 200 len: 1219 microversion: 2.1 time: 0.480794 Nov 02 12:39:53.623737 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 518/1055] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:53 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 1219 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:53.629065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:53.629650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:53.664123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.664666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.665294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:53.666274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:53.666610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:53.671931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.330870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:54.360243 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b1b8d3f3-754e-4088-b2fa-eab9975126d0 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1321 microversion: 2.1 time: 0.735345 Nov 02 12:39:54.365240 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 519/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:53 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1321 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:54.372047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:54.382740 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:54.405490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.410553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.411355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.412353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:54.417465 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:54.423682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:54.483132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:54.513734 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.compute.api [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Working on deleting snapshot d590c226-5d02-4bc1-a6d5-5e0824661e59 from shelved instance... Nov 02 12:39:58.683301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:58.685272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:59.927287 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=22 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:59.941816 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:02.533829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:03.623850 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:04.405745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=46 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:04.507437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:11.555534 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a3391f54-1ed4-4b38-ac10-d16f5ab75b79 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 200 len: 1435 microversion: 2.1 time: 21.547537 Nov 02 12:40:11.561384 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 538/1057] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 1435 bytes in 21553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:11.586064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:11.589690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:11.603172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.603865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.604375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.605262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.605731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.606241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.789086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Doing local delete in cell f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) {{(pid=127766) _delete /opt/stack/nova/nova/compute/api.py:2546}} Nov 02 12:40:11.791356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.795135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.797234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.799259 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.compute.api [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 02 12:40:11.812301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] deallocate_for_instance() {{(pid=127766) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Nov 02 12:40:11.842874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:11.864796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Instance cache missing network info. {{(pid=127766) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3300}} Nov 02 12:40:11.881031 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Updating instance_info_cache with network_info: [] {{(pid=127766) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Nov 02 12:40:11.932724 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cbced908-15a6-4e09-a6ce-7302f6443558 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.369844 Nov 02 12:40:11.934005 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 539/1058] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:11 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:11.941039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:11.941962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:11.954527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.954527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.954527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:11.954527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:11.954527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:11.956037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.138776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:12.154551 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c56407b4-e15e-4c91-8f3f-240d805cf7cf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 200 len: 1319 microversion: 2.1 time: 0.219227 Nov 02 12:40:12.155505 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 540/1059] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:11 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:12.161124 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:12.162010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:12.169267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.170182 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.170957 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.172011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.173316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.173984 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.463412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:12.486020 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eddaa1b8-da30-4a15-aab8-fb8e2601c308 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1471 microversion: 2.1 time: 0.326926 Nov 02 12:40:12.487753 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 541/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:12 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:12.823944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03b43bf-3491-4c06-8be8-6f70f679d53f", "tag": "e525a055-f6de-4e9a-b9cb-07d71ab395a1"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:12.868591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.869884 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.872168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:12.892878 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4b0f7680-c89f-43a5-bad5-fa0e6aaa8a7e tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 204 len: 0 microversion: 2.91 time: 18.524405 Nov 02 12:40:12.897952 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 520/1061] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:39:54 2022] DELETE /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 0 bytes in 18531 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:40:12.906740 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] Creating event network-changed:e525a055-f6de-4e9a-b9cb-07d71ab395a1 for instance d03b43bf-3491-4c06-8be8-6f70f679d53f on n-h1-857339-6 Nov 02 12:40:12.917299 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-1f9c7937-9afa-4323-81c9-8c3ce4c06ece req-bb00fd8c-d8ad-4a15-a7dd-e3f50d9474f6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426324 Nov 02 12:40:12.919491 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 542/1062] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:12.929457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04941205-20b8-4bc0-ab59-e14866c3f331", "tag": "8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:12.984564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:12.986459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:12.988300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.015159 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] Creating event network-changed:8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31 for instance 04941205-20b8-4bc0-ab59-e14866c3f331 on n-h1-857339-6 Nov 02 12:40:13.041049 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-ce340929-12ee-4bea-8160-ba78cd4a6be3 req-39927926-44d2-4764-b6a2-529fcd0f7d2d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133395 Nov 02 12:40:13.046999 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 521/1063] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:13.072409 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e2b05593-f91d-405f-8ada-eb4b9611aa4f tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c3734c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.110493 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-78a6f4df-4888-4f0e-b464-978f4d81491d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Calling method '.version_select at 0x7eff5c4b6430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.224914 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-78a6f4df-4888-4f0e-b464-978f4d81491d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-78a6f4df-4888-4f0e-b464-978f4d81491d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/images/9be6cd67-4bc1-4129-8ca4-c82fca6789c8/metadata/os_distro HTTP/1.1 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'image_id': '9be6cd67-4bc1-4129-8ca4-c82fca6789c8', 'id': 'os_distro'} Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9be6cd67-4bc1-4129-8ca4-c82fca6789c8 Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:13.235906 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9be6cd67-4bc1-4129-8ca4-c82fca6789c8 could not be found. Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-78a6f4df-4888-4f0e-b464-978f4d81491d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-78a6f4df-4888-4f0e-b464-978f4d81491d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "DELETE /compute/v2.1/images/9be6cd67-4bc1-4129-8ca4-c82fca6789c8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.316271 Nov 02 12:40:13.240827 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 543/1064] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:40:12 2022] DELETE /compute/v2.1/images/9be6cd67-4bc1-4129-8ca4-c82fca6789c8/metadata/os_distro => generated 62 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:13.294270 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e2b05593-f91d-405f-8ada-eb4b9611aa4f tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 200 len: 1435 microversion: 2.1 time: 0.226242 Nov 02 12:40:13.307523 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 522/1065] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 1435 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:13.332258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.334049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] [instance: f81c86aa-9de1-4bea-85c4-3998aea902e0] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.395064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.400535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.401986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.403709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.412532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.416695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.487090 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] HTTP exception thrown: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Request method failure captured: Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 HTTP/1.1 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmS_70YYOXP0QpAc6HBfnXByypKpqp0MgTghCZKzhRBmNJvNmSWlkGZqcwI5JiwwN6ev3iKj2iRVALosEltJb0fuebnraYEMfE8T1zb_dyvFV_AxVD6l_5XZ-RiC7FaElyR9XD0UGL09H-c_Z93lbe2OOLb_LGPKk2BXVGGXGNXWxI4 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.91 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4e0aa9b18c154964972a8c57c290dfe0 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-442781545 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4e0aa9b18c154964972a8c57c290dfe0", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4e0aa9b18c154964972a8c57c290dfe0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4e0aa9b18c154964972a8c57c290dfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4e0aa9b18c154964972a8c57c290dfe0"}]}] Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-442781545 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4e0aa9b18c154964972a8c57c290dfe0 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-442781545 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-UnshelveToHostMultiNodesTest-442781545-project Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ebf0681a98044ce29352cc8abdaa69f1 Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-442781545-project Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'f81c86aa-9de1-4bea-85c4-3998aea902e0'} Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.499269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. Nov 02 12:40:13.508612 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.513673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] Returning 404 to user: Instance f81c86aa-9de1-4bea-85c4-3998aea902e0 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:13.515610 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7a918ddc-eef5-46d1-9cdf-57c16b7121f9 tempest-UnshelveToHostMultiNodesTest-442781545 tempest-UnshelveToHostMultiNodesTest-442781545-project] 10.222.0.64 "GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0" status: 404 len: 111 microversion: 2.91 time: 0.213440 Nov 02 12:40:13.525207 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 523/1066] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/f81c86aa-9de1-4bea-85c4-3998aea902e0 => generated 111 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:13.546230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.547132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.570720 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.571771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.573083 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.574274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.574968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.575556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.615728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:13.617110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] [instance: ede1ee92-6487-4083-8056-2afc934f8d97] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.633344 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] HTTP exception thrown: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Request method failure captured: Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/ede1ee92-6487-4083-8056-2afc934f8d97/action HTTP/1.1 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 15 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmT253rKFcdzLk15eYjS-4lLiT-LkVxMMLqIJzT3pujP3ymwXtwUV-2D4cuTLf5N_41vvu_O5qhFWTVO3hKs208vv62KTQ_vjEgcwOouQwoP2Q5745VPZGSnkotQrb_8JjEEAd5J4h5QW9LNUGJtQOVgkFFKU5dbzhAaTrBaUEJAU5o Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6bd5c1f330104d60bfb991a53869a000", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}] Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 151f362ff88343c6b140c49366d88954 Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: {"migrate": {}} Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'ede1ee92-6487-4083-8056-2afc934f8d97', 'body': {'migrate': {}}} Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.640549 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. Nov 02 12:40:13.647138 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.649638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Returning 404 to user: Instance ede1ee92-6487-4083-8056-2afc934f8d97 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:13.650636 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9fece523-365b-4582-803d-d018cae3fa53 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/ede1ee92-6487-4083-8056-2afc934f8d97/action" status: 404 len: 111 microversion: 2.1 time: 0.411479 Nov 02 12:40:13.651265 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 544/1067] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:13 2022] POST /compute/v2.1/servers/ede1ee92-6487-4083-8056-2afc934f8d97/action => generated 111 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:13.666198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.666198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:13.700761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.702048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.706892 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.708761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:13.709539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:13.712852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:13.822844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:13.885099 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6d5c185f-afe5-4913-9796-ef49cadace6d tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.357902 Nov 02 12:40:13.889078 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 524/1068] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:13.897634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66d89916-3c21-4c9d-b36b-129240ce12d6 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Calling method '.version_select at 0x7eff5c373160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:13.988849 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-66d89916-3c21-4c9d-b36b-129240ce12d6 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66d89916-3c21-4c9d-b36b-129240ce12d6 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/images/ba687c7b-92d9-4134-b378-66e7f04f0a9c/metadata/os_version HTTP/1.1 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'image_id': 'ba687c7b-92d9-4134-b378-66e7f04f0a9c', 'id': 'os_version'} Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ba687c7b-92d9-4134-b378-66e7f04f0a9c Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:13.994375 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba687c7b-92d9-4134-b378-66e7f04f0a9c could not be found. Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:13.998593 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.006454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66d89916-3c21-4c9d-b36b-129240ce12d6 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:14.007669 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66d89916-3c21-4c9d-b36b-129240ce12d6 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "GET /compute/v2.1/images/ba687c7b-92d9-4134-b378-66e7f04f0a9c/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.119817 Nov 02 12:40:14.008519 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 525/1069] 10.222.0.64 () {58 vars in 1293 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/images/ba687c7b-92d9-4134-b378-66e7f04f0a9c/metadata/os_version => generated 62 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:14.013915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.019103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:14.041848 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.046004 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.046769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.048051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.049054 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.053206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.446122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:14.491093 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27c065a4-cdd6-4111-ac31-d6237b44ef3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 200 len: 1319 microversion: 2.1 time: 0.838233 Nov 02 12:40:14.492176 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 545/1070] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:13 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 1319 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.531929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5ec43e0b-1e57-42e5-a75d-6e716beaea58 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Calling method '.version_select at 0x7eff5c4b6040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5ec43e0b-1e57-42e5-a75d-6e716beaea58 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5ec43e0b-1e57-42e5-a75d-6e716beaea58 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/images/8f4e36ae-efdf-4af5-9b87-94c1553550fb/metadata HTTP/1.1 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'image_id': '8f4e36ae-efdf-4af5-9b87-94c1553550fb'} Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f4e36ae-efdf-4af5-9b87-94c1553550fb Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:14.601653 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f4e36ae-efdf-4af5-9b87-94c1553550fb could not be found. Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5ec43e0b-1e57-42e5-a75d-6e716beaea58 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5ec43e0b-1e57-42e5-a75d-6e716beaea58 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "GET /compute/v2.1/images/8f4e36ae-efdf-4af5-9b87-94c1553550fb/metadata" status: 404 len: 62 microversion: 2.1 time: 0.103560 Nov 02 12:40:14.612735 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 546/1071] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/images/8f4e36ae-efdf-4af5-9b87-94c1553550fb/metadata => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:14.636277 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04941205-20b8-4bc0-ab59-e14866c3f331", "name": "network-vif-plugged", "status": "completed", "tag": "8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:14.668379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:14.668731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:14.670077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:14.733344 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] Creating event network-vif-plugged:8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31 for instance 04941205-20b8-4bc0-ab59-e14866c3f331 on n-h1-857339-6 Nov 02 12:40:14.749214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-393b1f14-186f-47da-8793-1a559b8601a4 req-4e3a89e7-fe39-4149-9400-e13a10d7b92b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137092 Nov 02 12:40:14.752442 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 547/1072] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:14.769888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:14.772464 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1986962352", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:14.795959 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-044c74f3-ea74-4c28-8dfb-07c90ec7fca2 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1466 microversion: 2.1 time: 0.785654 Nov 02 12:40:14.817026 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 526/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:14 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1466 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:14.826567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f41b2139-0943-4696-9dff-5c2ce0cdc438 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Action: 'update_all', calling method: .version_select at 0x7eff5c373700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:14.985843 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f41b2139-0943-4696-9dff-5c2ce0cdc438 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f41b2139-0943-4696-9dff-5c2ce0cdc438 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/images/b362fa21-a278-41e9-a124-39c3f8393a0c/metadata HTTP/1.1 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 57 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'image_id': 'b362fa21-a278-41e9-a124-39c3f8393a0c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b362fa21-a278-41e9-a124-39c3f8393a0c Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:14.989654 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b362fa21-a278-41e9-a124-39c3f8393a0c could not be found. Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:14.998395 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:15.008095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f41b2139-0943-4696-9dff-5c2ce0cdc438 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:15.010369 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f41b2139-0943-4696-9dff-5c2ce0cdc438 tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "PUT /compute/v2.1/images/b362fa21-a278-41e9-a124-39c3f8393a0c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.184970 Nov 02 12:40:15.020303 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 527/1074] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:40:14 2022] PUT /compute/v2.1/images/b362fa21-a278-41e9-a124-39c3f8393a0c/metadata => generated 62 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:15.034643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e6af17c-3474-49b3-97bc-0512e1698973 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c366c10>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:15.059218 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:15.779204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:15.780023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:15.781394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:15.785577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:15.785577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:15.801135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.801135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.802192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.803918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:15.804840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:15.808274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:15.839241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Getting quotas for project d4fefce7b59b4135ab03a518f381e171. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:15.852828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Getting quotas for user 10f57760d0b5468b91c7b9666305dba9 and project d4fefce7b59b4135ab03a518f381e171. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:15.882857 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:15.886204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:16.067714 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5cd29cc9-1584-4565-8187-020f4e4f6c84 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311822 Nov 02 12:40:16.068912 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 548/1075] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1315 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:16.080120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:16.082659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:16.100587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.101769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.102506 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.103883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:16.104684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:16.105621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:16.273147 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:16.320031 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bbe7ae91-23c2-4c4c-9856-42066ff1c8b0 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.249248 Nov 02 12:40:16.320882 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 549/1076] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:16 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:16.338557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-44a43eaa-119b-499e-b6be-36f1e0b5e74d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Action: 'update', calling method: .version_select at 0x7eff5c43cc10>, body: {"meta": {"os_distro": "alt"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:16.406950 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-44a43eaa-119b-499e-b6be-36f1e0b5e74d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-44a43eaa-119b-499e-b6be-36f1e0b5e74d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: request: PUT /compute/v2.1/images/80b14cbc-7dc2-47d8-9855-88e7cc33918b/metadata/os_distro HTTP/1.1 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 30 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: {"meta": {"os_distro": "alt"}} Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'image_id': '80b14cbc-7dc2-47d8-9855-88e7cc33918b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 80b14cbc-7dc2-47d8-9855-88e7cc33918b Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:16.409254 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80b14cbc-7dc2-47d8-9855-88e7cc33918b could not be found. Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-44a43eaa-119b-499e-b6be-36f1e0b5e74d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-44a43eaa-119b-499e-b6be-36f1e0b5e74d tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "PUT /compute/v2.1/images/80b14cbc-7dc2-47d8-9855-88e7cc33918b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.089227 Nov 02 12:40:16.420871 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 550/1077] 10.222.0.64 () {60 vars in 1310 bytes} [Wed Nov 2 12:40:16 2022] PUT /compute/v2.1/images/80b14cbc-7dc2-47d8-9855-88e7cc33918b/metadata/os_distro => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:16.786633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1485693878", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "acbdb274-3500-41bb-be37-c59586c3474a"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:16.983386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] validate_networks() for [('acbdb274-3500-41bb-be37-c59586c3474a', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ff04435-38b0-4555-8650-3f4a6dc33408) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:17.609595 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ff04435-38b0-4555-8650-3f4a6dc33408) Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] Request method failure captured: Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 229 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmUugNKjuLsIYjbf9WFe7iGpTM0Bm9WpnXVqi5bpg_XNzjKUAAm4W1C8m-J94EIhy85RzoyPaOcTTMW6RT7teMBSa7FEExUaBb6fTFtftcDJsYVspsK0a8mjJdaI15rhtU1KwyP4vUF6JxRZAbvytNneq2UMFdTTHL3BJNDVvjX41xs Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a37fa59604f243cabf8504bac9207c89 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ListServersNegativeTestJSON-1259280325 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a37fa59604f243cabf8504bac9207c89", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a37fa59604f243cabf8504bac9207c89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a37fa59604f243cabf8504bac9207c89"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a37fa59604f243cabf8504bac9207c89"}]}] Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ListServersNegativeTestJSON-1259280325 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a37fa59604f243cabf8504bac9207c89 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1259280325 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ListServersNegativeTestJSON-1259280325-project Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 427b2bb4567545a89fc6c69bc409b5a5 Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ListServersNegativeTestJSON-1259280325-project Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1485693878", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "acbdb274-3500-41bb-be37-c59586c3474a"}]}} Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:17.616849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ListServersNegativeTestJSON-server-1485693878', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 3, 'networks': [{'uuid': 'acbdb274-3500-41bb-be37-c59586c3474a'}]}}} Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:17.626841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ff04435-38b0-4555-8650-3f4a6dc33408) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b365c947-8218-4ef0-8589-44318d072103 tempest-ListServersNegativeTestJSON-1259280325 tempest-ListServersNegativeTestJSON-1259280325-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.194586 Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 551/1078] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 1197 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:40:17.638115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:17.648331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:17.660308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.661719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.663696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:17.667738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:17.669066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:17.670134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.008553 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.024761 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66e6415f-f2ef-43e2-9981-2b630acdc9ef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 200 len: 1469 microversion: 2.1 time: 0.405797 Nov 02 12:40:18.026523 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 552/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:17 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 1469 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:18.040723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b5f8abd5-dca3-4713-9339-a70d0500c7da tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.042386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b5f8abd5-dca3-4713-9339-a70d0500c7da tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.152231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b5f8abd5-dca3-4713-9339-a70d0500c7da tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:18.164422 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b5f8abd5-dca3-4713-9339-a70d0500c7da tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1222 microversion: 2.1 time: 0.134345 Nov 02 12:40:18.175326 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 553/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1222 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:18.175326 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11b802d5-993f-4db5-8bb2-ce14b873f36b tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Action: 'create', calling method: .version_select at 0x7eff5c4b6700>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:18.232744 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-11b802d5-993f-4db5-8bb2-ce14b873f36b tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] HTTP exception thrown: Image not found. Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11b802d5-993f-4db5-8bb2-ce14b873f36b tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Request method failure captured: Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/images/8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d/metadata HTTP/1.1 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 57 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmUpwecwdWV3E752QV-0uZOd3TXPPMbtJho-4ySDv5BuecPwnp6sbqO_0kv-0POMPp6fCasbEPWGPL5yIFu1D0HcUPbyZNC4ZIcT5Hfm7IS5vUHdQms5Paz2UDCuk8xUtkDtVJRKKLoENND1XbDbeSCYG5z6-Xq9ITcMu0e9Jf-pOBg Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d93e3d867ed44dc4add656d02c389a4c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d93e3d867ed44dc4add656d02c389a4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d93e3d867ed44dc4add656d02c389a4c"}]}] Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d93e3d867ed44dc4add656d02c389a4c Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-159125766 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 35bb14eeab0142579ede81630b7017e5 Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-159125766-project Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'image_id': '8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:40:18.244284 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d could not be found. Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:18.251240 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:18.260305 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11b802d5-993f-4db5-8bb2-ce14b873f36b tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:18.261670 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-11b802d5-993f-4db5-8bb2-ce14b873f36b tempest-ImagesMetadataNegativeTestJSON-159125766 tempest-ImagesMetadataNegativeTestJSON-159125766-project] 10.222.0.64 "POST /compute/v2.1/images/8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.089504 Nov 02 12:40:18.263042 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 554/1081] 10.222.0.64 () {60 vars in 1281 bytes} [Wed Nov 2 12:40:18 2022] POST /compute/v2.1/images/8cdc4d2f-e80c-4de5-aedb-8f8f7a0f494d/metadata => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:18.481948 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9e6af17c-3474-49b3-97bc-0512e1698973 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "DELETE /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57" status: 204 len: 0 microversion: 2.1 time: 3.457864 Nov 02 12:40:18.486389 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 528/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:15 2022] DELETE /compute/v2.1/images/d7d4a15d-5252-4c80-8f58-4d6ec263ae57 => generated 0 bytes in 3461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:18.488258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.489014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.501717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.502214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.502658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.503376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.503831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.504255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.680571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:18.705081 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a6781915-6dc0-4e85-8ca3-8bd2ea6829a5 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.220943 Nov 02 12:40:18.706389 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 529/1083] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:18.711758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:18.712881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:18.720368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.724705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.724705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.724705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.724705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.724705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.883843 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:18.901129 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:18.901613 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:18.902048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:18.942526 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] Creating event network-vif-unplugged:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:40:18.953480 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-a64885b3-c167-4656-82e6-8f99fab2a8d7 req-5fd1a777-c893-49a2-b4bc-0e5e44291690 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.686517 Nov 02 12:40:18.955844 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 555/1084] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:18.961755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-226d7712-a9ad-4e1e-add6-7cf15e44c3d9 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '.version_select at 0x7eff5c38ef70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.006168 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-226d7712-a9ad-4e1e-add6-7cf15e44c3d9 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] HTTP exception thrown: Image not found. Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-226d7712-a9ad-4e1e-add6-7cf15e44c3d9 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Request method failure captured: Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 HTTP/1.1 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTB8h78vMr4OgpxOFurLEeIgue_KinfJ5h3-kBSqg-eUEOSrE24UcwqEj9S5wP7F2u83lMj2hKnJ2kMn2psEvhvYjzhiatvp3dyvZ_hkJsrlqUVznhypO7LsINOCrEXk1OWEe0EGeakOLzizMooia5NuKUbcyUIBoij9Cv5p5Fj0Fs Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_607346d5cd14420f930647ff1ecdb94d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}] Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 63589f909a744bf1afec7d1f2e659f8a Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: exception: Image not found. Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '7a3a0d13-1a0f-4d66-b9db-b447db936087'} Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7a3a0d13-1a0f-4d66-b9db-b447db936087 to delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a3a0d13-1a0f-4d66-b9db-b447db936087 could not be found. Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.008229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:40:19.013445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:19.017503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-226d7712-a9ad-4e1e-add6-7cf15e44c3d9 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Returning 404 to user: Image not found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:19.018744 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-226d7712-a9ad-4e1e-add6-7cf15e44c3d9 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "DELETE /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087" status: 404 len: 62 microversion: 2.1 time: 0.061298 Nov 02 12:40:19.023374 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 556/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:18 2022] DELETE /compute/v2.1/images/7a3a0d13-1a0f-4d66-b9db-b447db936087 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:19.030265 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.031223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.040809 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.041547 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.042206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.043283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.044008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.044759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.087469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:19.353470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.383423 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9fc5f13a-cd27-4dbb-b060-d216ec238aef tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1319 microversion: 2.1 time: 0.675512 Nov 02 12:40:19.384549 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 530/1086] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:18 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1319 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.414740 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.416182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.426771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.427926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.429165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.430226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.431048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.431915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.614845 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-46e57367-5b1f-4366-a501-8c9d6688920e tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "DELETE /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 204 len: 0 microversion: 2.1 time: 0.588442 Nov 02 12:40:19.616655 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 557/1087] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:19 2022] DELETE /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:19.645260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.647399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.676739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:19.691990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.694274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.699136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.704642 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.705975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.708183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.723766 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af8edd41-e069-4a7c-b942-44d5d06b0d9b tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1226 microversion: 2.1 time: 0.326991 Nov 02 12:40:19.726121 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 531/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1226 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:19.765894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:19.770107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:19.801139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.807577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.809156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:19.811474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:19.813002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:19.816208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.200598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:20.292188 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8b9961a0-31bb-4778-b19b-d97f46baa046 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.534749 Nov 02 12:40:20.299448 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 532/1089] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:20.423422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.425008 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.506916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.507937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.508788 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.512787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.512787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.512787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.589289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.621824 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4273aaa6-410b-4b1c-bf99-17897e5891dd tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1472 microversion: 2.1 time: 0.988705 Nov 02 12:40:20.629225 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 558/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:19 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1472 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:20.775905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:20.777358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:20.779647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:20.789609 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-11a58dc2-1c79-42e5-ad4b-7b3a05229830 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1319 microversion: 2.1 time: 0.377310 Nov 02 12:40:20.794679 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 533/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:20 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:20.802517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.803847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.804973 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.806532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:20.822817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:20.823557 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:20.997209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03b43bf-3491-4c06-8be8-6f70f679d53f", "name": "network-vif-plugged", "status": "completed", "tag": "e525a055-f6de-4e9a-b9cb-07d71ab395a1"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:21.027914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.029975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.032265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.070682 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] Creating event network-vif-plugged:e525a055-f6de-4e9a-b9cb-07d71ab395a1 for instance d03b43bf-3491-4c06-8be8-6f70f679d53f on n-h1-857339-6 Nov 02 12:40:21.083030 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-74a004bf-17a1-4e1f-bb0e-4bc25e3fdb66 req-3655586c-2c43-4efa-8e42-0a9592273f46 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098026 Nov 02 12:40:21.086744 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 534/1092] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:21.129970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:21.176722 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-871f42eb-a613-478f-bba8-834a0c70636c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1274 microversion: 2.1 time: 0.409509 Nov 02 12:40:21.193532 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 559/1093] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:20 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1274 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:21.329446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:21.330946 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.363273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.368228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.368228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.371764 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.373504 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.378443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.628596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:21.666642 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:21.667350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.689755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.690171 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.690943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.705335 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.705888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.712339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.793006 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f73efd1d-5a30-4d47-91c4-0d504dc9dcb1 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.470794 Nov 02 12:40:21.795227 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 535/1094] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:21 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:21.827713 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:21.829068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:21.866193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.867023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.867733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.868952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:21.869703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:21.870363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:21.902479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=15,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:22.882331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:22.894971 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e5c7e61f-3f36-4e82-8678-c71ec7c45459 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1472 microversion: 2.1 time: 1.233401 Nov 02 12:40:22.899497 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 560/1095] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:21 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1472 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:22.912837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:22.912837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:22.934686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.935705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.936413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.937599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:22.938530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:22.939197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:22.995304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:23.006021 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c1fa2fa4-a017-4868-b349-a017428580e1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1319 microversion: 2.1 time: 1.185399 Nov 02 12:40:23.006666 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 536/1096] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:21 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1319 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:23.049113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:23.049692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:23.052347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:23.064166 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c886c4d9-9acb-4c25-b0ba-4bfa0e44b584 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1280 microversion: 2.1 time: 0.162469 Nov 02 12:40:23.074564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.075375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.075992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.079619 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 561/1097] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:22 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:23.083193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.083911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.085035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.273844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:23.309129 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0f8e0e3f-3faa-4b0f-9a9d-049bdff4189f tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1927 microversion: 2.75 time: 0.275928 Nov 02 12:40:23.310373 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 537/1098] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:23 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1927 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:23.926580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:23.927475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:23.933975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.934675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.935119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:23.935846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:23.936303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:23.936759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.012636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:24.025716 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3267de64-dd32-4293-8e02-9dc5efc03386 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1430 microversion: 2.1 time: 0.104108 Nov 02 12:40:24.047264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:24.048242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:24.062335 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 562/1099] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:23 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1430 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:24.091996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.093844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.094395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.104647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:24.106032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:24.111813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.112369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.115163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.128641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.138415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.139597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.141342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.142406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.143817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.365887 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:24.388785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:24.413214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2f7a4afa-7ef2-45cd-ac4e-b20586d11484 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1280 microversion: 2.1 time: 0.311723 Nov 02 12:40:24.417529 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 563/1100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:24.447533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:24.456149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:24.474561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.478750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.483830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:24.484518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.486648 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.499255 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-47117d13-d9eb-49e4-87ce-b4488ebaaa49 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1468 microversion: 2.1 time: 0.471014 Nov 02 12:40:24.504645 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 538/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1468 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:24.512736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.513911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.714810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:24.786399 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0c02f27c-2000-44ed-9c5d-197c9435b675 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1945 microversion: 2.75 time: 0.358887 Nov 02 12:40:24.788272 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 564/1102] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1945 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:24.799929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cde6e93-3b90-4a9a-9290-ceb80a183a73", "name": "network-vif-deleted", "tag": "cdd384ae-5ca2-4ef8-b6eb-80221338be18"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:24.830602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.833292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.835327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:24.889873 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] Creating event network-vif-deleted:cdd384ae-5ca2-4ef8-b6eb-80221338be18 for instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 on n-h1-857339-6 Nov 02 12:40:24.902642 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-974b1e09-8017-4db2-9132-12d77df92b5e req-93aecbad-058f-402b-8fc9-f950036d1236 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108855 Nov 02 12:40:24.913653 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 565/1103] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:24.930767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:24.955606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:24.971240 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Searching by: {'reservation_id': 'r-qhi681ku', 'deleted': False, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4'} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:40:24.990700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:24.991318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:24.994704 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eba90e97-5ff0-47e6-8cbf-734b3871db1d tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.000763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.005254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.007407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.009922 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.032185 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eba90e97-5ff0-47e6-8cbf-734b3871db1d tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.492168 Nov 02 12:40:25.032185 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 539/1104] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:25.054580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2e21eb29-c4e5-4c9b-8026-e0b4c3101c84 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.142213 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2e21eb29-c4e5-4c9b-8026-e0b4c3101c84 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.101643 Nov 02 12:40:25.143238 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 540/1105] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.160824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.161919 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.183028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.184957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.186953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.188749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.189784 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.190755 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.278819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.279330 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.279773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.280234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lazy-loading 'fault' on Instance uuid 1cde6e93-3b90-4a9a-9290-ceb80a183a73 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:25.368583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.384426 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0004aa24-ed45-4b07-bff8-0bb5a5428768 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1306 microversion: 2.1 time: 0.239675 Nov 02 12:40:25.396338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.multi_cell_list [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:40:25.397156 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 541/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1306 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.408176 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f6e01e61-bc71-415c-a02b-0b5969c4f84c tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.417567 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f6e01e61-bc71-415c-a02b-0b5969c4f84c tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018888 Nov 02 12:40:25.418945 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 542/1107] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:25.445409 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-42d93abf-c465-4e03-921c-db976364f4be tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.471417 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-42d93abf-c465-4e03-921c-db976364f4be tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031438 Nov 02 12:40:25.479412 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 543/1108] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:25.492993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.492993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.509694 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.511021 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.513536 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.518825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.526692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.529358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.623375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.632877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.633930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.634641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.707182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:25.721006 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b94537e4-5b1c-4a5e-af17-f49b5f86d2f4 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1280 microversion: 2.1 time: 0.239936 Nov 02 12:40:25.721792 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 544/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1280 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.737674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4a3a65a6-8420-48c4-b8e1-6afdef5561b0 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.813122 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4a3a65a6-8420-48c4-b8e1-6afdef5561b0 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.088708 Nov 02 12:40:25.814296 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 545/1110] 10.222.0.64 () {58 vars in 1165 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:25.834447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d62add9-5769-42a6-b9d3-1fb049a98987 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.845455 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6d62add9-5769-42a6-b9d3-1fb049a98987 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014676 Nov 02 12:40:25.856354 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 546/1111] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:25.863042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:25.867911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:25.873151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.874185 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.874783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:25.875904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:25.876865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:25.877659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.073627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:26.110393 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b82847bf-2923-4e77-b486-7135148ad1f3 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1933 microversion: 2.75 time: 0.251871 Nov 02 12:40:26.124557 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 547/1112] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:25 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1933 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:26.137564 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7392fb3e-4792-432a-a382-9318e3eeda20 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/detail?reservation_id=r-qhi681ku" status: 200 len: 2930 microversion: 2.1 time: 1.206127 Nov 02 12:40:26.138529 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-859a96fb-8871-4819-951b-66b092ff32df tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.138707 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 566/1113] 10.222.0.64 () {58 vars in 1197 bytes} [Wed Nov 2 12:40:24 2022] GET /compute/v2.1/servers/detail?reservation_id=r-qhi681ku => generated 2930 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.153356 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-859a96fb-8871-4819-951b-66b092ff32df tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.040600 Nov 02 12:40:26.153952 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 548/1114] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.177854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e206146c-dc25-495e-98bb-a6aef996e4bd tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.198526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.202923 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e206146c-dc25-495e-98bb-a6aef996e4bd tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.033964 Nov 02 12:40:26.204462 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 567/1115] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:26.221306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-448d300e-8d96-447b-ac66-b341b841aaac tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.230353 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-448d300e-8d96-447b-ac66-b341b841aaac tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013536 Nov 02 12:40:26.239618 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 568/1116] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:26.245649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-73d8187f-938d-4b68-8766-4d7b3098c1bf tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.259227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.compute.server_groups [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Querying cell f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) for 2 instances {{(pid=127766) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:40:26.261488 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.262618 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.269603 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.295962 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-73d8187f-938d-4b68-8766-4d7b3098c1bf tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.054281 Nov 02 12:40:26.296995 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 569/1117] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:26.327977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a1a7be8e-869e-4649-8c17-c2fd31d7afe6 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.338015 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a1a7be8e-869e-4649-8c17-c2fd31d7afe6 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019659 Nov 02 12:40:26.347626 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 570/1118] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:26.354140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-439d2a96-8e33-4190-9d10-5e13059b96fb tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.386759 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3659edcb-b29c-407c-a82d-12dc04cade79 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups/7921c2e9-6367-409a-bc86-1be87e9441ad" status: 200 len: 264 microversion: 2.1 time: 0.191002 Nov 02 12:40:26.389912 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 549/1119] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/os-server-groups/7921c2e9-6367-409a-bc86-1be87e9441ad => generated 264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:26.390332 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-439d2a96-8e33-4190-9d10-5e13059b96fb tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.040484 Nov 02 12:40:26.402502 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 571/1120] 10.222.0.64 () {58 vars in 1144 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.410798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-14594276-ee2c-4750-95fe-9078317190e7 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.412336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.413647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.420597 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-14594276-ee2c-4750-95fe-9078317190e7 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016390 Nov 02 12:40:26.421636 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 572/1121] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:26.436823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.438429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.438802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.443766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.449080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.449080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.449080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.449631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.452453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.453486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.454274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.455369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.456139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.457066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.589676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.590727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.596598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.598635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lazy-loading 'fault' on Instance uuid 1cde6e93-3b90-4a9a-9290-ceb80a183a73 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:26.726388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63589f909a744bf1afec7d1f2e659f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '607346d5cd14420f930647ff1ecdb94d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:26.745804 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d4b36695-b252-4b4c-b183-084f87e43212 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 200 len: 1306 microversion: 2.1 time: 0.313605 Nov 02 12:40:26.756537 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 573/1122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.774617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-67b4832c-f33b-4ae3-8da5-92bafbaa3888 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.853594 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-67b4832c-f33b-4ae3-8da5-92bafbaa3888 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.098607 Nov 02 12:40:26.863269 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 574/1123] 10.222.0.64 () {58 vars in 1148 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:26.877130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:26.883892 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:26.895673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.896183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.896703 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:26.897556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:26.898024 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:26.898458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.307292 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-589654eb-eac6-4262-8759-307b0d54ce70 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 200 len: 1620 microversion: 2.1 time: 0.903290 Nov 02 12:40:27.316611 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 550/1124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 1620 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:27.330709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0980a24b-a3e3-4aeb-b83f-a7fc4ba720f6 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.391598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0980a24b-a3e3-4aeb-b83f-a7fc4ba720f6 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.072590 Nov 02 12:40:27.393664 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 551/1125] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Nov 2 12:40:27 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:27.402831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.403485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:27.414248 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.414819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.415263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.415996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.416458 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.416917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.575331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:27.603155 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8fc0b0d5-8dd2-45d9-8647-2a807b060346 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1933 microversion: 2.75 time: 0.208011 Nov 02 12:40:27.604665 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 552/1126] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:27 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1933 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:27.610517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:27.612152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:27.624332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.624332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.624332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:27.628999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:27.629770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:27.630820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.026906 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:28.053414 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e13e27d7-f1c2-48ff-855d-40f0e4c0dba7 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 1.182554 Nov 02 12:40:28.055018 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 575/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:26 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.063427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37b47099-6551-4770-8f52-38ea412e117d tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.076462 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37b47099-6551-4770-8f52-38ea412e117d tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019958 Nov 02 12:40:28.077432 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 576/1128] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:28.086823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.087998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] [instance: 1cde6e93-3b90-4a9a-9290-ceb80a183a73] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:28.095682 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:28.098247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.098878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.099795 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.100722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.101303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.101897 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.119056 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] HTTP exception thrown: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Request method failure captured: Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 HTTP/1.1 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTB8h78vMr4OgpxOFurLEeIgue_KinfJ5h3-kBSqg-eUEOSrE24UcwqEj9S5wP7F2u83lMj2hKnJ2kMn2psEvhvYjzhiatvp3dyvZ_hkJsrlqUVznhypO7LsINOCrEXk1OWEe0EGeakOLzizMooia5NuKUbcyUIBoij9Cv5p5Fj0Fs Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_607346d5cd14420f930647ff1ecdb94d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/607346d5cd14420f930647ff1ecdb94d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/607346d5cd14420f930647ff1ecdb94d"}]}] Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 607346d5cd14420f930647ff1ecdb94d Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-542141447 Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 63589f909a744bf1afec7d1f2e659f8a Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesOneServerTestJSON-542141447-project Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '1cde6e93-3b90-4a9a-9290-ceb80a183a73'} Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:28.121121 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] Returning 404 to user: Instance 1cde6e93-3b90-4a9a-9290-ceb80a183a73 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0342ec0f-0521-4077-a09c-e36037062f98 tempest-ImagesOneServerTestJSON-542141447 tempest-ImagesOneServerTestJSON-542141447-project] 10.222.0.64 "GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73" status: 404 len: 111 microversion: 2.1 time: 0.040970 Nov 02 12:40:28.127314 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 577/1129] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/servers/1cde6e93-3b90-4a9a-9290-ceb80a183a73 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:28.133315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-241cfbf8-22f2-40e4-b963-1598bb07cbe8 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c45ac10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.203014 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-241cfbf8-22f2-40e4-b963-1598bb07cbe8 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180" status: 200 len: 661 microversion: 2.1 time: 0.077877 Nov 02 12:40:28.204705 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 578/1130] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180 => generated 661 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:28.211066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d34503a1-8287-404a-9208-91c4cbd01e18 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.321563 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d34503a1-8287-404a-9208-91c4cbd01e18 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.095870 Nov 02 12:40:28.333282 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 579/1131] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.338859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5757f9e3-c44e-4b2f-b212-4e625e3457b0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c3891f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.358630 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cf7edbd4-a201-4995-8725-5ff04943711d tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1619 microversion: 2.1 time: 0.752330 Nov 02 12:40:28.360193 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 553/1132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:27 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1619 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.389479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a2ee0bf9-db6c-4254-947c-962c6ec67f19 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.445062 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5757f9e3-c44e-4b2f-b212-4e625e3457b0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180" status: 200 len: 661 microversion: 2.1 time: 0.104619 Nov 02 12:40:28.524171 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a2ee0bf9-db6c-4254-947c-962c6ec67f19 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.109763 Nov 02 12:40:28.524171 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 554/1133] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:28.527981 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 580/1134] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180 => generated 661 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:28.529204 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-737acf05-fdfa-4469-a15e-bffeb0bfa201 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.546149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: .version_select at 0x7eff5ceb6e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-623747531", "policies": ["anti-affinity"]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:28.573983 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-737acf05-fdfa-4469-a15e-bffeb0bfa201 tempest-FlavorsV2TestJSON-1162708894 tempest-FlavorsV2TestJSON-1162708894-project] 10.222.0.64 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.059393 Nov 02 12:40:28.579393 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 555/1135] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:28.645105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:28.660527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:28.671930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.674370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:28.690072 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.690709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.691447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.692547 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.693272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.694155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.849517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] Lazy-loading 'services' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:28.870961 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-721e1c49-87a1-4d1d-9a3e-fd17eb7bb341 tempest-ServersAdmin275Test-340537786 tempest-ServersAdmin275Test-340537786-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1918 microversion: 2.75 time: 0.212734 Nov 02 12:40:28.872058 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 556/1136] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:28 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1918 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:28.917340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:28.917816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:28.926344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.931661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.931661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.931661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:28.931661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:28.931661 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:28.990960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:29.134735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:29.147220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:29.170405 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8455256a-318d-4a88-ab16-febac470fe08 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.646151 Nov 02 12:40:29.172082 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 581/1137] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:40:28 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:29.182939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.184548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.211942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.212791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.213652 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.215421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.216637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.217462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.541443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:29.562458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.599006 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-227ea2bd-8c3c-4491-a5ed-6fc28eab63cf tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.408670 Nov 02 12:40:29.599006 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 582/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:29.640444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-725634676", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "8e720467-24a9-47fe-8368-506b0d2a7221"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:29.715886 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-87832e20-fad0-4203-8c92-e3ec561d1f13 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "DELETE /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 204 len: 0 microversion: 2.75 time: 0.802780 Nov 02 12:40:29.716899 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 557/1139] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:40:28 2022] DELETE /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 02 12:40:29.728382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:29.729360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:29.745934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:29.798167 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:29.891910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.905019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.907283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:29.914501 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-392295c8-ee18-4802-8d1f-7a0bec56ac9f tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1443 microversion: 2.75 time: 0.192073 Nov 02 12:40:29.923747 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 558/1140] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:29 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1443 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:30.320989 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:30.321663 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:30.322539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:30.323317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:30.324151 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:30.348892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c143fd1f-5e93-4432-b329-7ddd818dfe41", "tag": "0e0f5947-4737-4af3-8d98-eb03cc733e2a"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:30.353788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.354633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.355395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.356764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.357602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.358582 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.380431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.381283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.382793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.398473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:30.405689 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] Creating event network-changed:0e0f5947-4737-4af3-8d98-eb03cc733e2a for instance c143fd1f-5e93-4432-b329-7ddd818dfe41 on n-h2-857339-6 Nov 02 12:40:30.408960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:30.414258 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-35f02b4a-ba54-4e1a-b955-dcb749d664db req-02a1ce0e-5c53-4418-b3bf-45472436683c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.375346 Nov 02 12:40:30.415318 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 559/1141] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:40:30.428258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 2 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:30.432060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:30.620513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.622418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.638323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.639940 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.641312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.642777 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.643991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.645172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.686405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:30.689138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:30.704255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:30.882349 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:30.892913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:30.914466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=d66eec88-8a14-4f36-b486-84c06a042a69,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:30.923541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:30.946475 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fce25d3f-8473-4a6b-a7fe-ee4d73f31a1e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.334885 Nov 02 12:40:30.956730 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 560/1142] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:30 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:30.971332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:30.972462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:30.990152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.990902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.991528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:30.992554 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:30.993567 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:30.994558 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.079201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:31.080832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.090371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:31.097875 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.101255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.114372 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8a3b41c5-b8f7-43cf-a7d5-e75d7d9056b5 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1443 microversion: 2.75 time: 0.159848 Nov 02 12:40:31.116771 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 561/1143] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:30 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:31.338540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:31.359314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'server_group_members'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:31.437261 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e69ce8bf-8056-4c5c-aa0b-72e25dd75313 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.809184 Nov 02 12:40:31.438769 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 583/1144] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 1813 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:40:31.450200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.480199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.485128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Searching by: {'deleted': False, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4'} {{(pid=127766) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:40:31.542252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.542866 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.543375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.544220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:31.544972 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:31.545368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:31.629000 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.multi_cell_list [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=127766) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:40:31.745275 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ea91286e-2e44-41bc-a6d0-3b3db6ad6232 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c45a820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.761945 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-43413651-325d-4fed-9f8e-deb883fbcd9c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.317576 Nov 02 12:40:31.762988 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 562/1145] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers => generated 1664 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:31.791414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1fdc8ea4-2c60-4fa2-8828-9fcb606b8696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.792513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1fdc8ea4-2c60-4fa2-8828-9fcb606b8696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:31.874928 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ea91286e-2e44-41bc-a6d0-3b3db6ad6232 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925" status: 200 len: 662 microversion: 2.1 time: 0.137477 Nov 02 12:40:31.889400 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 584/1146] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925 => generated 662 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:31.901551 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1fdc8ea4-2c60-4fa2-8828-9fcb606b8696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:31.905071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-670021fd-d139-4d8d-ba4c-ad5826fb8561 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c489310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:31.929043 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1fdc8ea4-2c60-4fa2-8828-9fcb606b8696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1218 microversion: 2.1 time: 0.133551 Nov 02 12:40:31.930569 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 563/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1218 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:31.999340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.000913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:32.021530 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-670021fd-d139-4d8d-ba4c-ad5826fb8561 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925" status: 200 len: 662 microversion: 2.1 time: 0.123892 Nov 02 12:40:32.023198 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 585/1148] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925 => generated 662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:32.026833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.035866 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.040723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.044361 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.055229 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.057832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.165701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.172929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:32.211102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.216629 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.219754 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.224962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.226193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.232407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.366005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:32.366005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:32.366005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:32.366005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lazy-loading 'fault' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:32.376056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.389241 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d1011b0d-a6a3-4de5-802d-db7abf7adbde tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.397206 Nov 02 12:40:32.390965 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 564/1149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:31 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:32.462316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.481791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.486264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:32.498236 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-15e2a04c-7dbf-4af2-8049-c7a8c0da9163 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1448 microversion: 2.75 time: 0.340389 Nov 02 12:40:32.498236 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 586/1150] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:32 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1448 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:40:32.968831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e6396201-da9e-4bfd-bde3-2a68631f074d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:32.968831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e6396201-da9e-4bfd-bde3-2a68631f074d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.086620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e6396201-da9e-4bfd-bde3-2a68631f074d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.096470 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e6396201-da9e-4bfd-bde3-2a68631f074d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1218 microversion: 2.1 time: 0.141682 Nov 02 12:40:33.097736 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 565/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:32 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.428145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.428855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.442118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.443082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.443534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.444363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.444875 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.445314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.537483 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:33.538849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:33.550845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.551776 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.552672 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.554454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.555662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.556798 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.673975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:33.679697 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:33.679697 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:33.680292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:33.681114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lazy-loading 'fault' on Instance uuid 03cdc1b1-478f-4653-a77d-6b11cb517f86 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:33.767714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.774436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.784894 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7a5653cf-7654-449e-9c0b-0e147adebea1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.361940 Nov 02 12:40:33.785706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.786067 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 587/1152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:33.787629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da4d37ab3d0b40d59bdba72582fa86ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8ee21f74a1d415f9f42599927a503d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:33.797344 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ff41b643-a918-481a-aba0-1fd5233fb924 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 200 len: 1448 microversion: 2.75 time: 0.269875 Nov 02 12:40:33.809375 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 566/1153] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 1448 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:40:34.129738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bc305f51-c58d-4c77-badf-92c51769fc2b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.131309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bc305f51-c58d-4c77-badf-92c51769fc2b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.240002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bc305f51-c58d-4c77-badf-92c51769fc2b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:34.258083 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bc305f51-c58d-4c77-badf-92c51769fc2b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1218 microversion: 2.1 time: 0.125253 Nov 02 12:40:34.259413 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 567/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:34.333412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-daf676ed-9cf5-4555-8a88-6dc401e1590e tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] Calling method '.version_select at 0x7eff5c239280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.400638 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-daf676ed-9cf5-4555-8a88-6dc401e1590e tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] 10.222.0.64 "GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067" status: 200 len: 784 microversion: 2.1 time: 0.497309 Nov 02 12:40:34.401737 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 588/1155] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:33 2022] GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067 => generated 784 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:34.417956 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-be750a3b-03a8-4200-a585-957800c5605a tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] Calling method '.version_select at 0x7eff5c335670>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.513474 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-be750a3b-03a8-4200-a585-957800c5605a tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] 10.222.0.64 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.099503 Nov 02 12:40:34.514131 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 568/1156] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/images => generated 445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:34.531821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b1c106a3-a196-49f4-b67a-37c38678a762 tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] Calling method '.version_select at 0x7eff5c38e940>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.584217 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b1c106a3-a196-49f4-b67a-37c38678a762 tempest-ListImagesTestJSON-1324259660 tempest-ListImagesTestJSON-1324259660-project] 10.222.0.64 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.058027 Nov 02 12:40:34.588048 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 589/1157] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:34.816184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.816842 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.824916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.826213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.826213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.826706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.827174 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.827595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.844510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:34.846180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] [instance: 03cdc1b1-478f-4653-a77d-6b11cb517f86] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:34.857480 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.858580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.859593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.862204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:34.863100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:34.863855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:34.893484 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] HTTP exception thrown: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Request method failure captured: Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 HTTP/1.1 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTZN4xJiQZd9f_FVJgusGzx5KQlhiQfOzkJCNPbDRgbxNvYCa_0N87KEwyBnwf0rNePMcNzg3Xxl0MT1YScPzxYa1er441WHaFtjFgw1P32bXvL1gqQwIV6hzTz55Y63DpSz-w6hcbrI2nBM67GDGm3VmUIx2D69w7kEBz_A18lWdM Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Openstack-Nova-Api-Version: 2.75 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: b8ee21f74a1d415f9f42599927a503d8 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdmin275Test-2056958591 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b8ee21f74a1d415f9f42599927a503d8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b8ee21f74a1d415f9f42599927a503d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b8ee21f74a1d415f9f42599927a503d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b8ee21f74a1d415f9f42599927a503d8"}]}] Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdmin275Test-2056958591 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: b8ee21f74a1d415f9f42599927a503d8 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdmin275Test-2056958591 Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdmin275Test-2056958591-project Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: da4d37ab3d0b40d59bdba72582fa86ad Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdmin275Test-2056958591-project Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '03cdc1b1-478f-4653-a77d-6b11cb517f86'} Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:34.896995 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] Returning 404 to user: Instance 03cdc1b1-478f-4653-a77d-6b11cb517f86 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7569b6dc-aa3c-4f64-9eb8-752305d3deb7 tempest-ServersAdmin275Test-2056958591 tempest-ServersAdmin275Test-2056958591-project] 10.222.0.64 "GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86" status: 404 len: 111 microversion: 2.75 time: 0.064878 Nov 02 12:40:34.908952 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 590/1158] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/03cdc1b1-478f-4653-a77d-6b11cb517f86 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:40:35.230607 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.241895 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1d969cb6-038d-4768-bea6-843dc1cfd59c tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.431676 Nov 02 12:40:35.242991 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 569/1159] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:34 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:35.248763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e566f0ea-9da1-4cf9-8a9a-838e24ff4983 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.315028 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e566f0ea-9da1-4cf9-8a9a-838e24ff4983 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd" status: 200 len: 662 microversion: 2.1 time: 0.070240 Nov 02 12:40:35.316078 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 570/1160] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:35.325190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.326559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:35.337667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.338217 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.338681 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.339485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:35.339949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:35.340391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:35.428465 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:35.445157 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-175db2b8-1720-4e90-8c87-f67862110948 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1222 microversion: 2.1 time: 0.127075 Nov 02 12:40:35.446617 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 571/1161] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:35.462829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-17fdc202-d83e-4a40-9c9a-54de686894f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:35.559542 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-17fdc202-d83e-4a40-9c9a-54de686894f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd" status: 200 len: 662 microversion: 2.1 time: 0.102622 Nov 02 12:40:35.560652 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 572/1162] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:40:35 2022] GET /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:35.682998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-42a3c39f-a852-4e94-b5ee-ee116f13b84a tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1193604067", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:35.695297 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-42a3c39f-a852-4e94-b5ee-ee116f13b84a tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] HTTP exception thrown: min_count must be <= max_count Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-42a3c39f-a852-4e94-b5ee-ee116f13b84a tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Request method failure captured: Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 184 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVC2CZAttbS1KGs8BjCTb0IJ-3t04jmh4zTWw_GLVGcAThoJllvkdvglwBe5XnHptyY6HONDxR6ldvdq8RaWigE7Te9jlQTN5_hQaO_8_3t4iJPuAK7t-V0l_gv07xXp-WMj7NLu9gtsIZLcDn3rxVFvZ-1OALB1PNEmgCJy1Y4XqY Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc07510f94da475a8287361d97c0de06", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc07510f94da475a8287361d97c0de06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}] Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd15048680ee4daa91b3c7a10e1cd4ec Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1193604067", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 3, "max_count": 2}} Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: exception: min_count must be <= max_count Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1193604067', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Nov 02 12:40:35.699868 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:35.706818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-42a3c39f-a852-4e94-b5ee-ee116f13b84a tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Returning 400 to user: min_count must be <= max_count {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:35.710469 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-42a3c39f-a852-4e94-b5ee-ee116f13b84a tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.777827 Nov 02 12:40:35.713293 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 591/1163] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:34 2022] POST /compute/v2.1/servers => generated 74 bytes in 782 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 12:40:35.954859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-874754374", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:36.071184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:36.143950 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5d02d73f-9529-4e58-86a8-3a32b0349931 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-197377221", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "max_count": 0}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5d02d73f-9529-4e58-86a8-3a32b0349931 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Request method failure captured: Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 167 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVC2CZAttbS1KGs8BjCTb0IJ-3t04jmh4zTWw_GLVGcAThoJllvkdvglwBe5XnHptyY6HONDxR6ldvdq8RaWigE7Te9jlQTN5_hQaO_8_3t4iJPuAK7t-V0l_gv07xXp-WMj7NLu9gtsIZLcDn3rxVFvZ-1OALB1PNEmgCJy1Y4XqY Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc07510f94da475a8287361d97c0de06", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc07510f94da475a8287361d97c0de06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}] Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd15048680ee4daa91b3c7a10e1cd4ec Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-197377221", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "max_count": 0}} Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-197377221', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'max_count': 0}}} Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:36.172457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:36.177856 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:36.179173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5d02d73f-9529-4e58-86a8-3a32b0349931 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:36.185929 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5d02d73f-9529-4e58-86a8-3a32b0349931 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.054703 Nov 02 12:40:36.191020 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 592/1164] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:40:36.270773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:36.271827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:36.326697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.331248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.333477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:36.339175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:36.343399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:36.350026 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.079968 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.087290 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-37ffd6c2-834e-47cd-8344-cd417376e966 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.824224 Nov 02 12:40:37.088309 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 593/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:36 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:37.097946 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fc90f47b-4e22-4ef7-bf14-9c752817909b tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-669878031", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "max_count": 2.5}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fc90f47b-4e22-4ef7-bf14-9c752817909b tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Request method failure captured: Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 169 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVC2CZAttbS1KGs8BjCTb0IJ-3t04jmh4zTWw_GLVGcAThoJllvkdvglwBe5XnHptyY6HONDxR6ldvdq8RaWigE7Te9jlQTN5_hQaO_8_3t4iJPuAK7t-V0l_gv07xXp-WMj7NLu9gtsIZLcDn3rxVFvZ-1OALB1PNEmgCJy1Y4XqY Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc07510f94da475a8287361d97c0de06", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc07510f94da475a8287361d97c0de06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}] Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd15048680ee4daa91b3c7a10e1cd4ec Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-669878031", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "max_count": 2.5}} Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-669878031', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'max_count': 2.5}}} Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:37.107351 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.115585 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.122412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fc90f47b-4e22-4ef7-bf14-9c752817909b tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:37.122678 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fc90f47b-4e22-4ef7-bf14-9c752817909b tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.030506 Nov 02 12:40:37.123891 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 594/1166] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:37.137509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:37.140007 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:37.153150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.155069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.156223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.157774 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.158825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.160071 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.302118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:37.302987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:37.305246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:37.305246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:37.305246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:37.338190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.339037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.349577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.351778 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:37.352909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:37.354193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:37.438142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Getting quotas for project c0a42b724065423cb31303f3f9b55f36. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:37.470985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Getting quotas for user d03db5013be642b88ea298fba0d87f20 and project c0a42b724065423cb31303f3f9b55f36. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:37.520747 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:37.552691 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7700695a-943a-4fd3-b3a5-771dd76b4371 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1270 microversion: 2.1 time: 0.420541 Nov 02 12:40:37.556185 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:37.558046 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 595/1167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:37 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1270 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:37.581095 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ba92c419-7650-4d09-95ef-94fd93748725 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1971650002", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 0}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:37.582151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ba92c419-7650-4d09-95ef-94fd93748725 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Request method failure captured: Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 168 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVC2CZAttbS1KGs8BjCTb0IJ-3t04jmh4zTWw_GLVGcAThoJllvkdvglwBe5XnHptyY6HONDxR6ldvdq8RaWigE7Te9jlQTN5_hQaO_8_3t4iJPuAK7t-V0l_gv07xXp-WMj7NLu9gtsIZLcDn3rxVFvZ-1OALB1PNEmgCJy1Y4XqY Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc07510f94da475a8287361d97c0de06", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc07510f94da475a8287361d97c0de06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}] Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd15048680ee4daa91b3c7a10e1cd4ec Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1971650002", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 0}} Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1971650002', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 0}}} Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 0 Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:37.596566 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Nov 02 12:40:37.613219 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.617959 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ba92c419-7650-4d09-95ef-94fd93748725 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:37.619742 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ba92c419-7650-4d09-95ef-94fd93748725 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.059737 Nov 02 12:40:37.645231 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 596/1168] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:37 2022] POST /compute/v2.1/servers => generated 130 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:37.791644 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20b58a34-b702-4cba-b116-808cd46f4d49 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1627062063", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2.5}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:37.797481 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-33b0dcb0-8d22-4750-b9dd-f7611d5563a6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859261 Nov 02 12:40:37.801460 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 573/1169] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20b58a34-b702-4cba-b116-808cd46f4d49 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Request method failure captured: Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 170 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVC2CZAttbS1KGs8BjCTb0IJ-3t04jmh4zTWw_GLVGcAThoJllvkdvglwBe5XnHptyY6HONDxR6ldvdq8RaWigE7Te9jlQTN5_hQaO_8_3t4iJPuAK7t-V0l_gv07xXp-WMj7NLu9gtsIZLcDn3rxVFvZ-1OALB1PNEmgCJy1Y4XqY Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc07510f94da475a8287361d97c0de06", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc07510f94da475a8287361d97c0de06"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc07510f94da475a8287361d97c0de06"}]}] Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cc07510f94da475a8287361d97c0de06 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1574538484 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd15048680ee4daa91b3c7a10e1cd4ec Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1574538484-project Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1627062063", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2.5}} Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1627062063', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 2.5}}} Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minLength': 1, Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minimum': 1, Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['server']: Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 2.5 Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:37.810428 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20b58a34-b702-4cba-b116-808cd46f4d49 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:37.816234 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20b58a34-b702-4cba-b116-808cd46f4d49 tempest-MultipleCreateNegativeTestJSON-1574538484 tempest-MultipleCreateNegativeTestJSON-1574538484-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.032905 Nov 02 12:40:37.820324 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 597/1170] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:37 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:37.920010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1119577728", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:38.086155 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:38.136600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.140319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.178960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.179859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.210996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.212549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.213116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.219750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.721767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:38.733215 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-704a3cf8-2f6a-45e5-ae91-b6d992189883 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.608479 Nov 02 12:40:38.734565 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 598/1171] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:38 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:38.750624 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:38.751696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:38.761048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.761967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.762574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.763794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.764413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.768812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.795140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:40:38.798144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:40:38.798721 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:40:38.799201 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:40:38.799886 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:40:38.820469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.820469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.820469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.837830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:38.838973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:38.840634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:38.871593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Getting quotas for project c0a42b724065423cb31303f3f9b55f36. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:38.881960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Getting quotas for user d03db5013be642b88ea298fba0d87f20 and project c0a42b724065423cb31303f3f9b55f36. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:38.902439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:38.914209 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-709a68a4-068b-4557-ae83-298fd2a4a5ee tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1288 microversion: 2.1 time: 0.177444 Nov 02 12:40:38.925624 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 599/1172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:38 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1288 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:38.928517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:40:38.951619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:40:39.084578 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c143fd1f-5e93-4432-b329-7ddd818dfe41", "name": "network-vif-plugged", "status": "completed", "tag": "0e0f5947-4737-4af3-8d98-eb03cc733e2a"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:39.107172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.107712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.108179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.134951 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] Creating event network-vif-plugged:0e0f5947-4737-4af3-8d98-eb03cc733e2a for instance c143fd1f-5e93-4432-b329-7ddd818dfe41 on n-h2-857339-6 Nov 02 12:40:39.157670 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-b02977a2-d1a0-498d-8488-5c09f0717599 req-b2929407-d046-42c9-b632-5017e020d2b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090320 Nov 02 12:40:39.158576 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 600/1173] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:39.193609 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d3b7af73-5f9b-4651-9742-0ab9641d7765 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278615 Nov 02 12:40:39.206007 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 574/1174] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:40:39.218364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bf29c74f-9f0c-4cda-8b82-9bbc6fa02903 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:39.218364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bf29c74f-9f0c-4cda-8b82-9bbc6fa02903 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:39.436255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bf29c74f-9f0c-4cda-8b82-9bbc6fa02903 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:39.451052 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bf29c74f-9f0c-4cda-8b82-9bbc6fa02903 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1218 microversion: 2.1 time: 0.242788 Nov 02 12:40:39.464533 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 601/1175] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:39 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1218 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:39.777091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:39.777091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:39.794796 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.795870 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.802890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.802890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.802890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.802890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.950915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:39.952831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:39.979210 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.981120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.982212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:39.983166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:39.983856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:39.984815 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:40.331539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:40.355796 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bf2f67e0-4ffd-4c57-b613-e4ff54b66459 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1276 microversion: 2.1 time: 0.415197 Nov 02 12:40:40.356889 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 602/1176] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:39 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1276 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:40.432930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:40.457338 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-51932265-bf8e-48e6-8075-318ac2be7e8a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1322 microversion: 2.1 time: 0.676424 Nov 02 12:40:40.469499 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 575/1177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:39 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:40.505424 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-46311f1c-fb87-44cf-af5d-9035e812a570 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:40.506649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-46311f1c-fb87-44cf-af5d-9035e812a570 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:40.533765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=6 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:41.392654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.394270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.408390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-46311f1c-fb87-44cf-af5d-9035e812a570 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:41.419591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=43 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:41.425736 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-46311f1c-fb87-44cf-af5d-9035e812a570 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1218 microversion: 2.1 time: 0.925570 Nov 02 12:40:41.426583 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 603/1178] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:40 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1218 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:41.427636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.428968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.444059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.447531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.448855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.449496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.493295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:41.494135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:41.513940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.513940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.513940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:41.513940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:41.514456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:41.514805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.284474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:42.293448 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3adcda97-b507-4150-bb04-3d7f517e2257 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 0.915637 Nov 02 12:40:42.294087 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 576/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:42.346765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:42.361528 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-34bee078-b351-4e34-a17f-cceb5e8b569a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1472 microversion: 2.1 time: 0.873338 Nov 02 12:40:42.372416 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 604/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:41 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1472 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:42.400037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:42.400971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:42.425261 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.425905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.426725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.427516 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:42.427987 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:42.428432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:42.517772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=100 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:42.522522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lazy-loading 'flavor' on Instance uuid c143fd1f-5e93-4432-b329-7ddd818dfe41 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:43.091907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9a1486c5-7e22-4060-8bfd-7ff79f38241c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c38a3a0>, body: {"keypair": {"name": "tempest-keypair-207991435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCJvgBTo8qRcGOalfDK53SUIl9nCMI2RplaVa02v/BrpBi4HNMSVQ1XZDRNrrNgVdhXtFI+1PsIqJTnyU5c8JLgr09i9OieaH+Da1fzm6GYUj5xspQbGATGmLs86Mv9iw=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:43.171131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-9a1486c5-7e22-4060-8bfd-7ff79f38241c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:43.192786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-9a1486c5-7e22-4060-8bfd-7ff79f38241c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:43.193956 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c284532a-9398-473f-942e-61a1cbb42fed tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41/action" status: 202 len: 0 microversion: 2.1 time: 0.804809 Nov 02 12:40:43.194962 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 605/1181] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:42 2022] POST /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41/action => generated 0 bytes in 809 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:40:43.214522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:43.231089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:43.255739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.261321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.262423 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.279872 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.286041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.287016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.390881 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9a1486c5-7e22-4060-8bfd-7ff79f38241c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.095568 Nov 02 12:40:43.399386 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 577/1182] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:43.409482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:43.410729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:43.444993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.454509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.456324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:43.461572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:43.467803 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:43.471774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.181965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:44.209571 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1e4964d0-92da-4201-a131-1cd82f16dd8c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1214 microversion: 2.1 time: 1.003015 Nov 02 12:40:44.230543 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 606/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:43 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1214 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:44.259008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:44.268317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:44.304833 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.316992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.316992 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:44.318330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:44.320859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:44.324953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.283331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:45.301702 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dae4cd70-3df2-464f-aee9-b282875efcba tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 1.069195 Nov 02 12:40:45.302988 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 607/1184] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:44 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:45.316833 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-77fff2e6-7956-4bd1-84af-bbce0164478c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c2a01f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.342279 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-77fff2e6-7956-4bd1-84af-bbce0164478c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs/tempest-keypair-207991435" status: 200 len: 496 microversion: 2.1 time: 0.037688 Nov 02 12:40:45.349591 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 608/1185] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-207991435 => generated 496 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:45.366669 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e067965c-2afe-4b75-ace8-7b2ffba7b978", "tag": "5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:45.416819 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.418974 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.423279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.477082 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] Creating event network-changed:5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e for instance e067965c-2afe-4b75-ace8-7b2ffba7b978 on n-h1-857339-6 Nov 02 12:40:45.494154 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-04b9226d-3e82-4d7e-a77a-a185aea4455c req-c19b7ac0-dd9f-4dfe-a0bc-623b1f238b1c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142961 Nov 02 12:40:45.499418 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 609/1186] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:45.520528 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.523917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:45.540116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.547911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.547911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.547911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:45.547911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:45.547911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:45.834078 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:45.849644 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-30ef1c8a-7e75-45dc-b9f5-cc08a74a005b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1278 microversion: 2.1 time: 0.347219 Nov 02 12:40:45.870521 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 610/1187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:45 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:45.886882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4dbd281e-b34c-4eda-96f4-3a7f2fd91304 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c3a10d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:45.982098 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b0b0e66a-9ce5-4c76-81ce-303ac01ee821 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1631 microversion: 2.1 time: 2.580279 Nov 02 12:40:45.990875 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 578/1188] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:43 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1631 bytes in 2591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:46.031977 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4dbd281e-b34c-4eda-96f4-3a7f2fd91304 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-207991435" status: 202 len: 0 microversion: 2.1 time: 0.158896 Nov 02 12:40:46.032753 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 611/1189] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-207991435 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:46.049137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b029c1f-8675-49e6-86d9-312361df29ed tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c366ca0>, body: {"keypair": {"name": "tempest-keypair-1045009729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaImFiF3ONU6l9hfojRoMPh1JlYeZdof/FnulviBrklO+7lZK9iJZFfzzEMP7x7+A7s3faVHIC5kmsFKFGSUnByvathJ0eJ/VEfAKeoz8aVJia19qaOGihxPLGG40499g=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:46.083472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-9b029c1f-8675-49e6-86d9-312361df29ed tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:46.096999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-9b029c1f-8675-49e6-86d9-312361df29ed tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:46.132108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:46.224187 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b029c1f-8675-49e6-86d9-312361df29ed tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182527 Nov 02 12:40:46.230902 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 579/1190] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:46.240858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d4edeaa9-d9a2-47cb-aa16-1d20cb0a0041 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c2615e0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.335476 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.336322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:46.347962 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.348512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.349043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.351833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.354241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.356780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.415548 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d4edeaa9-d9a2-47cb-aa16-1d20cb0a0041 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045009729" status: 202 len: 0 microversion: 2.1 time: 0.182766 Nov 02 12:40:46.416299 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 612/1191] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045009729 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:40:46.430839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6cfdb315-35a8-4f33-ac5a-67df84b629dd tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c2393a0>, body: {"keypair": {"name": "tempest-keypair-1691918542", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:46.493279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-6cfdb315-35a8-4f33-ac5a-67df84b629dd tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:46.506452 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-6cfdb315-35a8-4f33-ac5a-67df84b629dd tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:46.748003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:46.752584 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6cfdb315-35a8-4f33-ac5a-67df84b629dd tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.328571 Nov 02 12:40:46.761515 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 613/1192] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:46 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:46.768902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-744040926", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "445a82ff-111d-4613-87ae-a6de9c7d7a94"}], "security_groups": [{"name": "tempest-securitygroup--1199223362"}], "key_name": "tempest-keypair-1704113207", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5be80c23-e14a-439f-aba7-23c4fd3d34ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:46.773608 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-67c27266-fda4-40c0-9385-b82c8cc476e7 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 0.445592 Nov 02 12:40:46.789792 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 580/1193] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:46 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:46.816614 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b1a4884c-9e36-4308-8e39-d7ce6ee3b7d8 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c3a3a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.973300 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b1a4884c-9e36-4308-8e39-d7ce6ee3b7d8 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691918542" status: 202 len: 0 microversion: 2.1 time: 0.178428 Nov 02 12:40:46.974231 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 581/1194] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1691918542 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:46.986698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:46.988095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:46.994937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.995577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.996330 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:46.997531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:46.998006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:46.998425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.464920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:47.478814 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9b32e7dd-629a-47c9-83b0-70e06b5e4587 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1276 microversion: 2.1 time: 0.501659 Nov 02 12:40:47.480141 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 582/1195] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:46 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1276 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:47.540543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] validate_networks() for [('445a82ff-111d-4613-87ae-a6de9c7d7a94', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:40:47.671206 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1a272cde-392a-4514-84c0-77c42c616411 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A40%3A46.966749&end=2022-11-03T12%3A40%3A46.966749" status: 404 len: 112 microversion: - time: 0.189025 Nov 02 12:40:47.672520 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 583/1196] 10.222.0.64 () {58 vars in 1316 bytes} [Wed Nov 2 12:40:47 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-11-01T12%3A40%3A46.966749&end=2022-11-03T12%3A40%3A46.966749 => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:40:47.678368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb126f6b-ef56-4c13-9840-f9708f48f08e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c4addc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-599111828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4Lvq4irUuV8eEqjgEkuD/jjJQ6TqyA6F7mUnLvzpmYp65ouGRxW+duKqRSzvEQqczYmOc66nogNx82W1EqUpnfH318qnyZ3yVqH0djGjHBSRmIzoKkGInF1fJLuNFUjQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:47.704909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-eb126f6b-ef56-4c13-9840-f9708f48f08e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:47.714933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-eb126f6b-ef56-4c13-9840-f9708f48f08e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:47.919196 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb126f6b-ef56-4c13-9840-f9708f48f08e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.245221 Nov 02 12:40:47.926133 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 584/1197] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:47 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:47.931275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:47.932658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:47.941297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.942365 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.943025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.944687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:47.945406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:47.946144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a58021ae-1caa-4778-bedb-37d1901980c1) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:47.988904 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a58021ae-1caa-4778-bedb-37d1901980c1) Nov 02 12:40:47.993384 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:47.995982 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:47.995982 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Request method failure captured: Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 788 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmT_agFplPvQETm1pwbIO2kWUYjxP446Iwd5sbVc_VD9cXn1SIGtA8GhYKyi41Fst-CeaFPuM9hjpzzeaWeyYtoG28uo7BQidcx3S0awe__6aLDjoqIU_IHw_xbk_cRNH8DsDM-ENqCGXLe6TNxMa3LV8oyHY6Lkvs3fMcZxzuLXxYk Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f871d4dccfa64340ae699fe84bb10a79 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestBootFromVolume-1981627584 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f871d4dccfa64340ae699fe84bb10a79", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f871d4dccfa64340ae699fe84bb10a79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f871d4dccfa64340ae699fe84bb10a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f871d4dccfa64340ae699fe84bb10a79"}]}] Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestBootFromVolume-1981627584 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f871d4dccfa64340ae699fe84bb10a79 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1981627584 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestBootFromVolume-1981627584-project Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 99582f1c239d4209a1909c5a849de953 Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestBootFromVolume-1981627584-project Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestBootFromVolume-server-744040926", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "L1*7Kwd~zDYUWym", "networks": [{"uuid": "445a82ff-111d-4613-87ae-a6de9c7d7a94"}], "security_groups": [{"name": "tempest-securitygroup--1199223362"}], "key_name": "tempest-keypair-1704113207", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "5be80c23-e14a-439f-aba7-23c4fd3d34ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestBootFromVolume-server-744040926', 'imageRef': '', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'L1*7Kwd~zDYUWym', 'networks': [{'uuid': '445a82ff-111d-4613-87ae-a6de9c7d7a94'}], 'security_groups': [{'name': 'tempest-securitygroup--1199223362'}], 'key_name': 'tempest-keypair-1704113207', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '5be80c23-e14a-439f-aba7-23c4fd3d34ad'}]}}} Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:40:47.999068 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:48.004229 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a58021ae-1caa-4778-bedb-37d1901980c1) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:48.014179 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bdc87ffd-0340-4ad0-b0c6-6332722206e2 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.253491 Nov 02 12:40:48.020635 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 614/1198] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 1265 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:40:48.030216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66eec88-8a14-4f36-b486-84c06a042a69", "tag": "ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:48.042962 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.043664 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.044425 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.057841 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] Creating event network-changed:ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be for instance d66eec88-8a14-4f36-b486-84c06a042a69 on n-h2-857339-6 Nov 02 12:40:48.064897 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-51eda9d0-d380-4c8b-a09f-4313e6960fe3 req-8183d406-0302-415a-a69f-d446d947fcec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042226 Nov 02 12:40:48.065801 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 615/1199] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:48.070965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b6832c29-5b36-40d5-84f5-422f26317750 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] Calling method '.version_select at 0x7eff5c1dad30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.075932 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b6832c29-5b36-40d5-84f5-422f26317750 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b6832c29-5b36-40d5-84f5-422f26317750 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] Request method failure captured: Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-simple-tenant-usage/271f7632e1bc4beaa12b86a4a7c945ac?start=2022-11-03T12%3A40%3A46.966749&end=2022-11-01T12%3A40%3A46.966749 HTTP/1.1 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVO835oLEV3cWy7wojWLDHKSqnKKFmbuSMsT4-J0TSxrsTXpEzBEVu9j4NbsC42nGOHclWXWRqxBTWKUV6WKQUss1q5kS29fUFWh9059xOFq0bwOxLEAOaFc_M2shDbOQTafLkkR6TbnPbyXmiZq0GFb9gc2gqfVEN1IUs2-KzF_f0 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: b4fbf34d98834a2ba93963a2f06ca483 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-995131781 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b4fbf34d98834a2ba93963a2f06ca483", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4fbf34d98834a2ba93963a2f06ca483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b4fbf34d98834a2ba93963a2f06ca483"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b4fbf34d98834a2ba93963a2f06ca483"}]}] Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-995131781 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: b4fbf34d98834a2ba93963a2f06ca483 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-995131781 Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TenantUsagesNegativeTestJSON-995131781-project-admin Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bb467af767924fb988534fa6d84e65ca Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-995131781-project-admin Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid start time. The start time cannot occur after the end time. Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '271f7632e1bc4beaa12b86a4a7c945ac'} Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._show(req, id) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Nov 02 12:40:48.084415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.091647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b6832c29-5b36-40d5-84f5-422f26317750 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:48.101421 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b6832c29-5b36-40d5-84f5-422f26317750 tempest-TenantUsagesNegativeTestJSON-995131781 tempest-TenantUsagesNegativeTestJSON-995131781-project-admin] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage/271f7632e1bc4beaa12b86a4a7c945ac?start=2022-11-03T12%3A40%3A46.966749&end=2022-11-01T12%3A40%3A46.966749" status: 400 len: 111 microversion: 2.1 time: 0.034316 Nov 02 12:40:48.102380 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 616/1200] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/os-simple-tenant-usage/271f7632e1bc4beaa12b86a4a7c945ac?start=2022-11-03T12%3A40%3A46.966749&end=2022-11-01T12%3A40%3A46.966749 => generated 111 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:48.109993 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.110757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.122359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.122949 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.123541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.124297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.124854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.125290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.368198 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fd6f2859-32d1-4977-b8bc-f449a66664e5 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1614 microversion: 2.1 time: 0.443149 Nov 02 12:40:48.370368 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 585/1201] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:47 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1614 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:48.386417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6637c530-e681-4efc-8474-7392a95a543c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c366c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1554912035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFO8Il/NAovabJ44+qjF2kass9UDDhvDzcy3rXpgo5wSPRHkwnjzsjwMTKlLO2o84u/mriVtV/3sU0jiRB4R2oCNlonhU7hXHnQDF+lsN2S2otZeTn+HjoH8lAm0hV8upw=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:48.409911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-6637c530-e681-4efc-8474-7392a95a543c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:48.417985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-6637c530-e681-4efc-8474-7392a95a543c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:48.622699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:48.632631 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b5c5cbf7-64fd-4aa7-b41e-a95a901a5c6b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 0.528212 Nov 02 12:40:48.633472 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 617/1202] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:48.639391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-474b943a-b4d5-49bf-8ac3-56bff5550f80 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] Calling method '.version_select at 0x7eff5c1df9d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.676981 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6637c530-e681-4efc-8474-7392a95a543c tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.305501 Nov 02 12:40:48.678033 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 586/1203] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:48.814985 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-474b943a-b4d5-49bf-8ac3-56bff5550f80 tempest-ServersTestBootFromVolume-1981627584 tempest-ServersTestBootFromVolume-1981627584-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704113207" status: 202 len: 0 microversion: 2.1 time: 0.179524 Nov 02 12:40:48.815911 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 618/1204] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704113207 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:48.827630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:48.833010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.853303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9322dd4-12bc-4529-8b83-c8f3e105edf1 tempest-TenantUsagesNegativeTestJSON-336731891 tempest-TenantUsagesNegativeTestJSON-336731891-project] Calling method '.version_select at 0x7eff5c2690d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.863018 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f9322dd4-12bc-4529-8b83-c8f3e105edf1 tempest-TenantUsagesNegativeTestJSON-336731891 tempest-TenantUsagesNegativeTestJSON-336731891-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '68c5007e674247d3bcf3015ce7555262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271f7632e1bc4beaa12b86a4a7c945ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9322dd4-12bc-4529-8b83-c8f3e105edf1 tempest-TenantUsagesNegativeTestJSON-336731891 tempest-TenantUsagesNegativeTestJSON-336731891-project] Request method failure captured: Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A40%3A46.966749&end=2022-11-03T12%3A40%3A46.966749&detailed=1 HTTP/1.1 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVMeewaJESzYjqHUQvw2la25yECGM-pI9ZySCiKX6-hlUDvtkTN0t5qZcs6WusxViyTBsVv_ycaV6znNucxjQz2etbcK2bI5Wvm9ZEo9eXplk1gVEXYbC-BdAETLyL1S4xMVmtxlOggHr4wG0SVGMWO7kMQPSZHjSJ7zlGxw_AzzJU Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 271f7632e1bc4beaa12b86a4a7c945ac Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-336731891 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_271f7632e1bc4beaa12b86a4a7c945ac", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/271f7632e1bc4beaa12b86a4a7c945ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/271f7632e1bc4beaa12b86a4a7c945ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/271f7632e1bc4beaa12b86a4a7c945ac"}]}] Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-336731891 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 271f7632e1bc4beaa12b86a4a7c945ac Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-336731891 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TenantUsagesNegativeTestJSON-336731891-project Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 68c5007e674247d3bcf3015ce7555262 Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-336731891-project Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._index(req) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:40:48.866937 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Nov 02 12:40:48.879538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:48.882442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.882442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.882442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.882442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.882442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.886995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.892590 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9322dd4-12bc-4529-8b83-c8f3e105edf1 tempest-TenantUsagesNegativeTestJSON-336731891 tempest-TenantUsagesNegativeTestJSON-336731891-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:48.894871 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f9322dd4-12bc-4529-8b83-c8f3e105edf1 tempest-TenantUsagesNegativeTestJSON-336731891 tempest-TenantUsagesNegativeTestJSON-336731891-project] 10.222.0.64 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A40%3A46.966749&end=2022-11-03T12%3A40%3A46.966749&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.212543 Nov 02 12:40:48.896661 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 587/1205] 10.222.0.64 () {58 vars in 1335 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-11-01T12%3A40%3A46.966749&end=2022-11-03T12%3A40%3A46.966749&detailed=1 => generated 123 bytes in 216 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:48.900440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:48.923847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:48.933825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:48.957903 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.962139 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.966312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:48.967902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:48.973952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:48.975141 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:49.085720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51) Nov 02 12:40:49.090747 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.095131 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:49.095131 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Request method failure captured: Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41/action HTTP/1.1 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 15 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmT253rKFcdzLk15eYjS-4lLiT-LkVxMMLqIJzT3pujP3ymwXtwUV-2D4cuTLf5N_41vvu_O5qhFWTVO3hKs208vv62KTQ_vjEgcwOouQwoP2Q5745VPZGSnkotQrb_8JjEEAd5J4h5QW9LNUGJtQOVgkFFKU5dbzhAaTrBaUEJAU5o Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6bd5c1f330104d60bfb991a53869a000", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}] Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 151f362ff88343c6b140c49366d88954 Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: {"migrate": {}} Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'c143fd1f-5e93-4432-b329-7ddd818dfe41', 'body': {'migrate': {}}} Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:40:49.099745 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-93e06cb6-e49e-4f9f-8661-0b7a9e1a2a51) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:49.105841 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-070ab294-1bc4-4f59-b545-2ef635a08017 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41/action" status: 500 len: 214 microversion: 2.1 time: 0.291886 Nov 02 12:40:49.120070 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 619/1206] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:48 2022] POST /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41/action => generated 214 bytes in 295 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:40:49.136334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7738ac1e-2a29-4c1a-9043-5a0c13e8c35b tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Action: 'create', calling method: .version_select at 0x7eff5c2611f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-259040016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcfuAbRuT1H+RB2oMj2gXJJm2uPo6OY3y7LOfJfKi/wHGnlzX1ZfuUkxg+PmRybRbndxa9hwD6e9ZBFYkAW9FEXwpa6l6oBJ0yY5JuriNmx29rs2gp04FQ7sJXQzmKXXQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:49.184573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-7738ac1e-2a29-4c1a-9043-5a0c13e8c35b tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:40:49.195679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-7738ac1e-2a29-4c1a-9043-5a0c13e8c35b tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Getting quotas for user 6e170406c98d4785bcf2b7aad09d87ad and project feda62220be34c3ba9917176fb75f95f. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:40:49.448404 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7738ac1e-2a29-4c1a-9043-5a0c13e8c35b tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.322182 Nov 02 12:40:49.453491 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 620/1207] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:40:49 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:49.470098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de17c202-58f6-4d51-9e68-02a103ac0c0f tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de17c202-58f6-4d51-9e68-02a103ac0c0f tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Request method failure captured: Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action HTTP/1.1 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 39 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmT253rKFcdzLk15eYjS-4lLiT-LkVxMMLqIJzT3pujP3ymwXtwUV-2D4cuTLf5N_41vvu_O5qhFWTVO3hKs208vv62KTQ_vjEgcwOouQwoP2Q5745VPZGSnkotQrb_8JjEEAd5J4h5QW9LNUGJtQOVgkFFKU5dbzhAaTrBaUEJAU5o Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6bd5c1f330104d60bfb991a53869a000", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}] Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 151f362ff88343c6b140c49366d88954 Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: {"os-resetState": {"state": "invalid"}} Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '2ea316b7-8375-4c4b-b84a-73ba6b2f40f3', 'body': {'os-resetState': {'state': 'invalid'}}} Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'invalid' Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:49.476861 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de17c202-58f6-4d51-9e68-02a103ac0c0f tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de17c202-58f6-4d51-9e68-02a103ac0c0f tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action" status: 400 len: 144 microversion: 2.1 time: 0.025709 Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 621/1208] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:49 2022] POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action => generated 144 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:49.491975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d50e0a74-8c3b-4b82-8ad0-7d060defcf3a tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c1da3a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.497085 n-d-857339-6 devstack@n-api.service[127767]: WARNING oslo_db.sqlalchemy.utils [None req-d50e0a74-8c3b-4b82-8ad0-7d060defcf3a tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:40:49.519321 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d50e0a74-8c3b-4b82-8ad0-7d060defcf3a tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.028662 Nov 02 12:40:49.520256 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 622/1209] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:40:49 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:49.525808 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-556dfd9d-3143-4076-9ec7-c9e698d93bd1 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-556dfd9d-3143-4076-9ec7-c9e698d93bd1 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Request method failure captured: Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action HTTP/1.1 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 31 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmT253rKFcdzLk15eYjS-4lLiT-LkVxMMLqIJzT3pujP3ymwXtwUV-2D4cuTLf5N_41vvu_O5qhFWTVO3hKs208vv62KTQ_vjEgcwOouQwoP2Q5745VPZGSnkotQrb_8JjEEAd5J4h5QW9LNUGJtQOVgkFFKU5dbzhAaTrBaUEJAU5o Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6bd5c1f330104d60bfb991a53869a000", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}] Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 151f362ff88343c6b140c49366d88954 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: {"os-resetState": {"state": 1}} Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '2ea316b7-8375-4c4b-b84a-73ba6b2f40f3', 'body': {'os-resetState': {'state': 1}}} Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 1 Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:40:49.537029 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-556dfd9d-3143-4076-9ec7-c9e698d93bd1 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-556dfd9d-3143-4076-9ec7-c9e698d93bd1 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action" status: 400 len: 120 microversion: 2.1 time: 0.017770 Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 623/1210] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:40:49 2022] POST /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3/action => generated 120 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:40:49.549556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66cc38c5-574a-4e5c-9134-06f8fb9857cf tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c43cca0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.611377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:49.621392 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-811292a7-57e1-4997-9afc-01f7fc674bf6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 0.722081 Nov 02 12:40:49.623438 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 588/1211] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:48 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:49.629077 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:49.649304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Failed to fetch instance by id 999 {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2981}} Nov 02 12:40:49.649304 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] HTTP exception thrown: Instance 999 could not be found. Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Request method failure captured: Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 37 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmT253rKFcdzLk15eYjS-4lLiT-LkVxMMLqIJzT3pujP3ymwXtwUV-2D4cuTLf5N_41vvu_O5qhFWTVO3hKs208vv62KTQ_vjEgcwOouQwoP2Q5745VPZGSnkotQrb_8JjEEAd5J4h5QW9LNUGJtQOVgkFFKU5dbzhAaTrBaUEJAU5o Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6bd5c1f330104d60bfb991a53869a000", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6bd5c1f330104d60bfb991a53869a000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6bd5c1f330104d60bfb991a53869a000"}]}] Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 6bd5c1f330104d60bfb991a53869a000 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1659096305 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 151f362ff88343c6b140c49366d88954 Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1659096305-project-admin Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: {"os-resetState": {"state": "error"}} Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 999 could not be found. Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:49.655534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:49.661817 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:49.661817 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Nov 02 12:40:49.661817 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:49.661817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:49.662188 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-151cc657-60ae-4a06-94a5-5be98f200b82 tempest-ServersAdminNegativeTestJSON-1659096305 tempest-ServersAdminNegativeTestJSON-1659096305-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036347 Nov 02 12:40:49.666688 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 589/1212] 10.222.0.64 () {60 vars in 1179 bytes} [Wed Nov 2 12:40:49 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:40:49.677651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.679225 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:49.688070 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66cc38c5-574a-4e5c-9134-06f8fb9857cf tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-259040016" status: 202 len: 0 microversion: 2.1 time: 0.145319 Nov 02 12:40:49.690560 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 624/1213] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:40:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-259040016 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:49.696920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.697421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.700868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.701123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:49.701123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:49.701299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.701497 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.702114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.709865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:49.726594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.727226 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.728049 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.735216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:49.735216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:49.735216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:49.795136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:40:50.063779 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:50.077262 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-99a48657-0050-40f0-9181-ffe00c3dd819 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 0.408062 Nov 02 12:40:50.094268 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 590/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:49 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:50.100655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a6f3fb18-ae41-4cf2-acc3-98b828cd7b5e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c2aae50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.241433 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a6f3fb18-ae41-4cf2-acc3-98b828cd7b5e tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1554912035" status: 202 len: 0 microversion: 2.1 time: 0.145766 Nov 02 12:40:50.242265 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 591/1215] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 12:40:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1554912035 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:40:50.253160 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d295aca5-3430-4779-b20d-052534db7ab6 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] Calling method '.version_select at 0x7eff5c27a5e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.309602 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ee10895f-0e2e-47f0-b59a-85ba583523cc tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 204 len: 0 microversion: 2.1 time: 0.617054 Nov 02 12:40:50.311093 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 625/1216] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:40:49 2022] DELETE /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:40:50.324246 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.326005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:50.351727 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.353026 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d295aca5-3430-4779-b20d-052534db7ab6 tempest-KeyPairsV2TestJSON-1892811295 tempest-KeyPairsV2TestJSON-1892811295-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-599111828" status: 202 len: 0 microversion: 2.1 time: 0.103510 Nov 02 12:40:50.353249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.354202 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.355291 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 592/1217] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:40:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-599111828 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:40:50.362652 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.363643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.364378 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.654123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:50.655255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:50.679178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.680068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.680907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:50.692589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:50.694490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:50.702676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.185738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:51.207466 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-254e4eec-8a6f-402b-be43-6a7721ffa1ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1469 microversion: 2.1 time: 0.890942 Nov 02 12:40:51.208520 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 626/1218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:50 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1469 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:51.214080 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:51.217695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:51.235686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.236626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.247707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:51.250599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:51.250599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:51.250599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.158471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.161839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:52.182306 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3e83234c-153c-47dd-96f5-dc3a8310295c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 1.539001 Nov 02 12:40:52.183238 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 593/1219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:50 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:52.255136 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:52.256035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:52.264193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:52.264730 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:52.266550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.267759 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:52.268671 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:52.269286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:52.554530 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.569695 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0f71e156-b70a-4d13-be25-a8c5d5465e84 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 1.359511 Nov 02 12:40:52.570300 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 627/1220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:51 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:52.939574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:52.955035 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1dc17b4a-c7f8-4cad-bcf6-97978fdba9d1 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1469 microversion: 2.1 time: 0.703915 Nov 02 12:40:52.956331 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 594/1221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:52 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1469 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:40:53.210760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.211367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:53.225874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.226522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.227248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.228030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.228526 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.228952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.282920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3918a345-1137-499b-a19a-da0d58f91a74", "tag": "be6cb95f-365e-4c40-be18-d4841fe5acf9"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:53.308073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.309271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.312903 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.329777 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] Creating event network-changed:be6cb95f-365e-4c40-be18-d4841fe5acf9 for instance 3918a345-1137-499b-a19a-da0d58f91a74 on n-h1-857339-6 Nov 02 12:40:53.336461 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-31438815-43af-42b7-b235-4ed4e6249ebc req-03bc7d84-70c3-4943-b7d5-342451c00623 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058592 Nov 02 12:40:53.337424 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 595/1222] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:53.603682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:53.603682 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:53.621503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.623063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.623519 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.632282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:53.632282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:53.632282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:53.962903 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:53.977136 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-54f294b7-335b-419b-9310-517f87bffbd3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 0.770865 Nov 02 12:40:53.993091 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 628/1223] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:54.003433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:54.003433 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:54.009482 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.010235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.010751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.011478 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.011979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.012710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.335277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:54.343854 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-36576b89-26fd-46d7-851d-74b38dcc1b15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 0.746190 Nov 02 12:40:54.345175 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 596/1224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:54.350276 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e067965c-2afe-4b75-ace8-7b2ffba7b978", "name": "network-vif-plugged", "status": "completed", "tag": "5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:54.383118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:54.386948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:54.388812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:54.427538 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] Creating event network-vif-plugged:5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e for instance e067965c-2afe-4b75-ace8-7b2ffba7b978 on n-h1-857339-6 Nov 02 12:40:54.443003 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-92283020-4615-4898-b5a1-01e3425d33ec req-6ce40a3c-43e1-4f93-acde-d46918942563 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091867 Nov 02 12:40:54.445998 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 597/1225] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:54.620160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:54.637159 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4dc9ef38-0729-4957-96dc-774b447d03ae tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1469 microversion: 2.1 time: 0.642535 Nov 02 12:40:54.656814 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 629/1226] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:53 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1469 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:55.010494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:55.025611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:55.067639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.068210 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.069932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:55.070741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.071219 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.071659 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:55.262061 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c143fd1f-5e93-4432-b329-7ddd818dfe41", "name": "network-vif-deleted", "tag": "0e0f5947-4737-4af3-8d98-eb03cc733e2a"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:55.331325 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.332009 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.333119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:55.407831 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] Creating event network-vif-deleted:0e0f5947-4737-4af3-8d98-eb03cc733e2a for instance c143fd1f-5e93-4432-b329-7ddd818dfe41 on n-h2-857339-6 Nov 02 12:40:55.429009 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-aa69f565-1e29-46d5-9c9f-57c9639deeea req-5e66ddef-2373-4531-b39e-377477427f6c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184725 Nov 02 12:40:55.445860 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 630/1227] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:55.448398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:55.449220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:55.488667 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.488667 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.489564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:55.491998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:55.493013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:55.499965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.548782 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:56.579576 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1534c2b1-977b-4e23-97b3-1c69320a5e5f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 1.575707 Nov 02 12:40:56.582261 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 598/1228] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:55 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:56.612922 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:56.641247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.641247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.641966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.666900 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] Creating event network-changed:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:40:56.676248 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-fd3cb9d8-0fd2-4f51-ad02-8e801b8222e0 req-01446050-55bd-40ca-9eb2-c1a970820d59 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076612 Nov 02 12:40:56.681598 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 599/1229] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:56.687032 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:56.687893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:56.699750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.700658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.701408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.703169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.704423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.706131 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.712925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:56.724628 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e412a1b0-d421-4fd3-94bf-97f1b05b92f5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1318 microversion: 2.1 time: 1.282043 Nov 02 12:40:56.725904 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 631/1230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:55 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1318 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:56.733327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66eec88-8a14-4f36-b486-84c06a042a69", "name": "network-vif-plugged", "status": "completed", "tag": "ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:56.744386 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.745496 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.746211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.760920 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] Creating event network-vif-plugged:ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be for instance d66eec88-8a14-4f36-b486-84c06a042a69 on n-h2-857339-6 Nov 02 12:40:56.768055 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-b8b50f54-3266-4ec4-9424-21c92be50d11 req-01f4fd29-b8a1-4971-b98d-7d047a35badb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040324 Nov 02 12:40:56.769063 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 632/1231] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:40:56.802293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:56.802293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:56.803901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:56.805326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lazy-loading 'fault' on Instance uuid c143fd1f-5e93-4432-b329-7ddd818dfe41 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:40:56.959442 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:56.986193 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-44f91635-4ac8-45a4-b02a-0a7cca1d499e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 200 len: 1312 microversion: 2.1 time: 0.305868 Nov 02 12:40:57.009023 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 600/1232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:56 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 1312 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:57.635430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:57.636323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:57.675670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.683345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.686409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.697577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.697577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.697577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.775577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:57.779632 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:57.805179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.809035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.809035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.809035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:57.814283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:57.821515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:57.834099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:58.442142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=34 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:58.992263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:59.021754 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9635051c-dcdc-4af1-a23a-db5276401eb0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1466 microversion: 2.1 time: 1.255461 Nov 02 12:40:59.022345 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 601/1233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:57 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1466 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:59.035549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:59.036395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: c143fd1f-5e93-4432-b329-7ddd818dfe41] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:59.051617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.052931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.054723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.055891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.059242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.059937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.100049 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] HTTP exception thrown: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Request method failure captured: Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 HTTP/1.1 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTzRn__yZg8wvIQ1iRjnHRrlh9oKMrqEPaPh7MG6KVEwDeg_g2pdjuU8jVkr5MVuoBfQD6O_XqBzNFCzExIPQPVgFwRWSfFfMq3Hg_IzfOh_KgXlP8ZLPGMzyUt0nTkQ70fdOMkJNxZdwgpkgSMRfpzHsKO1XhQC8P5Gf_FGHPS0-k Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d4fefce7b59b4135ab03a518f381e171 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d4fefce7b59b4135ab03a518f381e171", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d4fefce7b59b4135ab03a518f381e171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d4fefce7b59b4135ab03a518f381e171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d4fefce7b59b4135ab03a518f381e171"}]}] Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d4fefce7b59b4135ab03a518f381e171 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersAdminNegativeTestJSON-1298122812-project Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 10f57760d0b5468b91c7b9666305dba9 Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1298122812-project Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'c143fd1f-5e93-4432-b329-7ddd818dfe41'} Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:59.109576 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Returning 404 to user: Instance c143fd1f-5e93-4432-b329-7ddd818dfe41 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:40:59.114629 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0ecc79dc-776f-4e20-8846-c9897476445e tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41" status: 404 len: 111 microversion: 2.1 time: 0.082988 Nov 02 12:40:59.120599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:40:59.121281 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 602/1234] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:59 2022] GET /compute/v2.1/servers/c143fd1f-5e93-4432-b329-7ddd818dfe41 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:40:59.147746 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-07215286-c510-44ee-a14d-93735d54a9dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 1.527307 Nov 02 12:40:59.148806 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 633/1235] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:57 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:40:59.170368 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:40:59.172709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:40:59.180618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.181684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.185365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.187951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:40:59.188805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:40:59.189565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:40:59.217982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=9 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:40:59.615746 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-598773399", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:40:59.684564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] validate_networks() for [('f13e3e60-3e47-42b6-9e73-35adfea76c73', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:00.108206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:00.151819 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1807f930-47d8-40fc-a1b8-a6837111d492 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 200 len: 1468 microversion: 2.1 time: 0.989734 Nov 02 12:41:00.166865 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 634/1236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:40:59 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 1468 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:00.172408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:00.189182 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:00.200854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.204034 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.207000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.211821 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.213126 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.213952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.273915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:00.411803 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685) Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Request method failure captured: Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 199 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVZ9qSxoUcW4sEhODrMOLXGS2nKywUNz-ss_USprdnxs7oIQ5kl0VEt8DcsAV7vSfg3qQ8T9-tYtPvraP1MWubu8aIkBG8WttPv4CQp3Gnw6Jy6tJ1eE9C-5pyICt7yonaiFuxbvSdGJfD5pccLGugMvu9ClAmX36SPSpQtlBUpk8U Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b371bd21fb44fc1948e03029ee437c3", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}] Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 2d4bf3d5375d4931be76850f6eb372a2 Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ImagesTestJSON-server-598773399", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-598773399', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f13e3e60-3e47-42b6-9e73-35adfea76c73'}]}}} Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:00.426085 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:00.438524 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0d2a3ad0-86dd-4829-a1b9-1b8d10740685) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-930970b3-e902-4aeb-ba35-58e95cfba93f tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.306166 Nov 02 12:41:00.447857 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 603/1237] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:40:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1316 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:00.471442 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:00.471891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:00.495159 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.501544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.501544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.501544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.501544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.501544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.805352 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f8632599-485f-43bb-bf6e-c9f4a2db67e9 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 204 len: 0 microversion: 2.1 time: 0.640363 Nov 02 12:41:00.809345 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 635/1238] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:41:00 2022] DELETE /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:00.819035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:00.826361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:00.828402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Searching by: {'reservation_id': 'r-r0k0wt1c', 'deleted': False, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4'} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:41:00.850714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.855909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.856381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:00.864750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:00.867689 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:00.868673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:01.019213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:01.021591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.multi_cell_list [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:41:01.032110 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7c055a1a-6036-45e4-8769-2540b962f088 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 0.590118 Nov 02 12:41:01.039042 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 604/1239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:00 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:01.045143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2122419630", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:01.113834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:01.122409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:01.123256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:01.123900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:01.222512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] validate_networks() for [('f13e3e60-3e47-42b6-9e73-35adfea76c73', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:01.639198 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-691173de-f8bc-4a62-8ea7-27d81519f8e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/detail?reservation_id=r-r0k0wt1c" status: 200 len: 2927 microversion: 2.1 time: 0.826427 Nov 02 12:41:01.642648 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 636/1240] 10.222.0.64 () {58 vars in 1197 bytes} [Wed Nov 2 12:41:00 2022] GET /compute/v2.1/servers/detail?reservation_id=r-r0k0wt1c => generated 2927 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:01.649270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:01.655361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:01.677408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:01.677908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:01.682832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:01.683957 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:01.684878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:01.685498 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:02.073320 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1) Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:02.078115 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Request method failure captured: Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 200 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVZ9qSxoUcW4sEhODrMOLXGS2nKywUNz-ss_USprdnxs7oIQ5kl0VEt8DcsAV7vSfg3qQ8T9-tYtPvraP1MWubu8aIkBG8WttPv4CQp3Gnw6Jy6tJ1eE9C-5pyICt7yonaiFuxbvSdGJfD5pccLGugMvu9ClAmX36SPSpQtlBUpk8U Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b371bd21fb44fc1948e03029ee437c3", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}] Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 2d4bf3d5375d4931be76850f6eb372a2 Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ImagesTestJSON-server-2122419630", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-2122419630', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f13e3e60-3e47-42b6-9e73-35adfea76c73'}]}}} Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:02.083075 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dc9dfb68-8136-41e4-80c4-9098c3cd62f1) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:02.087530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-91a99500-209d-41b6-afb4-c81b3b69ec4b tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.046136 Nov 02 12:41:02.091099 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 605/1241] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 1048 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:02.160691 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.190277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.compute.server_groups [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Querying cell f00f0d66-5cbd-45f5-9ce5-838ebd846832(cell1) for 2 instances {{(pid=127766) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Nov 02 12:41:02.191556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.192238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.192921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.227147 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ee3bdf0f-253d-4210-b3a5-c2ca27cba1eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups/8e720467-24a9-47fe-8368-506b0d2a7221" status: 200 len: 270 microversion: 2.1 time: 0.140092 Nov 02 12:41:02.228149 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 606/1242] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/os-server-groups/8e720467-24a9-47fe-8368-506b0d2a7221 => generated 270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:02.236260 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.237202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:02.245757 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.246744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.247385 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.248437 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.249186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.250631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.284229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:02.309552 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c6ea53b-838d-4d0c-a855-a1613f9b79ef tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1477 microversion: 2.1 time: 0.662339 Nov 02 12:41:02.316601 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 637/1243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:01 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1477 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:02.323888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1273835542", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:02.712867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:02.727725 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8f1f6e5e-456c-4471-a595-ad4f79caa9df tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 0.497984 Nov 02 12:41:02.728878 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 607/1244] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:02.735002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:02.737088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:02.746024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.758254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.758254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:02.758254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:02.758254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:02.758254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.011780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] validate_networks() for [('f13e3e60-3e47-42b6-9e73-35adfea76c73', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:03.808866 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e76ad94e-db7f-4cc7-a97a-8e3e88b04dc3 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 200 len: 1619 microversion: 2.1 time: 1.070405 Nov 02 12:41:03.832522 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 608/1245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:02 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 1619 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:03.861985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:03.865779 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:03.902935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.907290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.912993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:03.912993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:03.912993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:03.914254 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:04.112779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0) Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Request method failure captured: Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 200 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVZ9qSxoUcW4sEhODrMOLXGS2nKywUNz-ss_USprdnxs7oIQ5kl0VEt8DcsAV7vSfg3qQ8T9-tYtPvraP1MWubu8aIkBG8WttPv4CQp3Gnw6Jy6tJ1eE9C-5pyICt7yonaiFuxbvSdGJfD5pccLGugMvu9ClAmX36SPSpQtlBUpk8U Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b371bd21fb44fc1948e03029ee437c3", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}] Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 2d4bf3d5375d4931be76850f6eb372a2 Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ImagesTestJSON-server-1273835542", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1273835542', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f13e3e60-3e47-42b6-9e73-35adfea76c73'}]}}} Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:04.120368 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:04.135112 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2bc69fa5-cf16-4b0d-8b8c-b2913d7311d0) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-be004e0a-4a9c-4990-9656-4d3fbbc72cff tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.801832 Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 638/1246] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:02 2022] POST /compute/v2.1/servers => generated 214 bytes in 1808 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:04.144051 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:04.165332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:04.180155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:04.180155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:04.180155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:04.180155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:04.180155 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.091046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:05.110003 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-93a72448-8e2b-4e2d-b018-328b5f51ff0a tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1477 microversion: 2.1 time: 1.286369 Nov 02 12:41:05.111260 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 609/1247] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:03 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1477 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:05.116397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:05.121332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:05.145027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:05.150179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:05.150797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.151815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:05.152917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:05.161481 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.169567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:05.191514 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-159bf96b-0f3b-4fca-b5da-3d0af066208f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 1.063496 Nov 02 12:41:05.192039 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 639/1248] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:04 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:05.204317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1475589968", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:05.453339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] validate_networks() for [('f13e3e60-3e47-42b6-9e73-35adfea76c73', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:05.895185 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7752d00c-3325-4f5b-bb38-54c1189c48cf tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1617 microversion: 2.1 time: 0.782412 Nov 02 12:41:05.909836 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 610/1249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:05 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1617 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:05.909836 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3918a345-1137-499b-a19a-da0d58f91a74", "name": "network-vif-plugged", "status": "completed", "tag": "be6cb95f-365e-4c40-be18-d4841fe5acf9"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:05.940296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:05.941064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:05.941629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:05.978861 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] Creating event network-vif-plugged:be6cb95f-365e-4c40-be18-d4841fe5acf9 for instance 3918a345-1137-499b-a19a-da0d58f91a74 on n-h1-857339-6 Nov 02 12:41:05.991084 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-314032fc-bda1-49f0-9021-8309e9077f03 req-68e0d715-b950-4275-8ed2-e2a005e7b0d9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086509 Nov 02 12:41:05.992544 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 611/1250] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:06.138839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:06.141733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:06.157844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.158840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.168633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:06.168633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.168633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.168633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:06.307698 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93) Nov 02 12:41:06.311843 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.317112 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:06.317112 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Request method failure captured: Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 200 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVZ9qSxoUcW4sEhODrMOLXGS2nKywUNz-ss_USprdnxs7oIQ5kl0VEt8DcsAV7vSfg3qQ8T9-tYtPvraP1MWubu8aIkBG8WttPv4CQp3Gnw6Jy6tJ1eE9C-5pyICt7yonaiFuxbvSdGJfD5pccLGugMvu9ClAmX36SPSpQtlBUpk8U Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b371bd21fb44fc1948e03029ee437c3", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}] Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 2d4bf3d5375d4931be76850f6eb372a2 Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ImagesTestJSON-server-1475589968", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1475589968', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f13e3e60-3e47-42b6-9e73-35adfea76c73'}]}}} Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:06.320097 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f56f61c7-d8c0-42de-9e72-dfce6dbe6b93) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:06.324989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.335831 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:06.344912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:06.344912 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:06.365515 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c08e9d41-0ce2-4d51-aebe-d66eddcfebe9 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.148808 Nov 02 12:41:06.365515 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 640/1251] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:05 2022] POST /compute/v2.1/servers => generated 214 bytes in 1150 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:06.365515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:06.365515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:06.385924 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.386757 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.387377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:06.388335 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:06.390713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:06.391399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:07.209149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:07.223610 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ab992cc3-74d1-4d68-bb9d-b59722e5520b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1318 microversion: 2.1 time: 0.870251 Nov 02 12:41:07.228860 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 641/1252] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:06 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1318 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:07.240388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-615830749", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "48de1b1f-9d7e-41bf-b1e6-023d17cecc0e"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:07.391902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:07.441865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:07.461441 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d4cf2720-6b8b-4c7a-a725-0059122ea547 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1477 microversion: 2.1 time: 1.327112 Nov 02 12:41:07.462046 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 612/1253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:06 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1477 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:07.487463 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1025338213", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:07.616934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] validate_networks() for [('f13e3e60-3e47-42b6-9e73-35adfea76c73', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:08.237621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:08.238692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:08.239745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:08.240654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:08.242681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:08.269375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.270638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.271677 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.273322 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.274365 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.275432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.324867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:08.342813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:08.409266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:08.415336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2a05fd9-cf13-4df2-b524-fd32f4312c12) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:08.619690 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2a05fd9-cf13-4df2-b524-fd32f4312c12) Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:08.628199 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Request method failure captured: Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 200 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVZ9qSxoUcW4sEhODrMOLXGS2nKywUNz-ss_USprdnxs7oIQ5kl0VEt8DcsAV7vSfg3qQ8T9-tYtPvraP1MWubu8aIkBG8WttPv4CQp3Gnw6Jy6tJ1eE9C-5pyICt7yonaiFuxbvSdGJfD5pccLGugMvu9ClAmX36SPSpQtlBUpk8U Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b371bd21fb44fc1948e03029ee437c3", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b371bd21fb44fc1948e03029ee437c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b371bd21fb44fc1948e03029ee437c3"}]}] Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1b371bd21fb44fc1948e03029ee437c3 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesTestJSON-1557022812 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 2d4bf3d5375d4931be76850f6eb372a2 Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesTestJSON-1557022812-project Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ImagesTestJSON-server-1025338213", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f13e3e60-3e47-42b6-9e73-35adfea76c73"}]}} Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ImagesTestJSON-server-1025338213', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f13e3e60-3e47-42b6-9e73-35adfea76c73'}]}}} Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:08.634047 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f2a05fd9-cf13-4df2-b524-fd32f4312c12) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:08.649484 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ec206e12-a5f1-46a5-9d61-84748f6d5e33 tempest-ImagesTestJSON-1557022812 tempest-ImagesTestJSON-1557022812-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.163167 Nov 02 12:41:08.658138 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 613/1254] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 1180 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:08.690307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea316b7-8375-4c4b-b84a-73ba6b2f40f3", "name": "network-vif-deleted", "tag": "d52229ec-7865-402d-84bb-7a7568d392fd"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:08.753438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.754362 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.756650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.773209 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cb1548a6-0428-41f2-8df0-10c91ff9f883 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.529210 Nov 02 12:41:08.774491 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 642/1255] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:08.784291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:08.793088 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] Creating event network-vif-deleted:d52229ec-7865-402d-84bb-7a7568d392fd for instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 on n-h1-857339-6 Nov 02 12:41:08.815184 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-8f7d93a1-9871-4a79-873a-e080fa2737bb req-7a7715ba-fc14-4971-95f9-b729c7a7d687 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149992 Nov 02 12:41:08.816900 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 614/1256] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:08.818111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:08.838463 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ea316b7-8375-4c4b-b84a-73ba6b2f40f3", "name": "network-vif-unplugged", "status": "completed", "tag": "d52229ec-7865-402d-84bb-7a7568d392fd"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:08.853431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.854554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.855167 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.859475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.862426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.866747 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.918893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:08.921238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:08.922382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:08.959222 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] Creating event network-vif-unplugged:d52229ec-7865-402d-84bb-7a7568d392fd for instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 on n-h1-857339-6 Nov 02 12:41:08.984472 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-2367baf5-d4f6-4f91-af09-af2f7d015e4a req-01e17ebb-aff2-476c-94af-6c4a5c42513d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162017 Nov 02 12:41:08.988926 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 615/1257] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:09.006923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:09.012358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:09.027073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.045120 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.047089 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.052250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.054479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.055223 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.151208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:09.170111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:09.171281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:09.172074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:09.172980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lazy-loading 'fault' on Instance uuid 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:41:09.883670 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f57760d0b5468b91c7b9666305dba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4fefce7b59b4135ab03a518f381e171', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:09.902826 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c0870d4b-7da7-41b4-8b7f-9489ad1faeeb tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 200 len: 1311 microversion: 2.1 time: 0.912165 Nov 02 12:41:09.903799 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 616/1258] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:08 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 1311 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:09.919461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-26d47ce9-3bd7-402b-9616-45bfd2f5be1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:09.919461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-26d47ce9-3bd7-402b-9616-45bfd2f5be1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:10.308083 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:10.308717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-26d47ce9-3bd7-402b-9616-45bfd2f5be1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:10.336798 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-26d47ce9-3bd7-402b-9616-45bfd2f5be1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1216 microversion: 2.1 time: 0.431170 Nov 02 12:41:10.338575 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 617/1259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:09 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1216 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:10.346402 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a446b010-81a4-4d3e-a260-58356552e5ef tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1468 microversion: 2.1 time: 1.570072 Nov 02 12:41:10.352788 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 643/1260] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:08 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1468 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:10.404874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:10.411281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:10.458679 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.469063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.481324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.487007 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:10.488511 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:10.490455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:10.534028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: .version_select at 0x7eff5c274af0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1734006502", "policies": ["affinity"]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:10.679768 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:10.701409 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:11.051634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:11.067524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:11.094214 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e765bf27-cff5-4692-ac05-a24f438c9a17 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.753179 Nov 02 12:41:11.113717 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 618/1261] 10.222.0.64 () {60 vars in 1174 bytes} [Wed Nov 2 12:41:10 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:11.124953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.128080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] [instance: 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:11.144245 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.144880 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.145353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.146302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.146754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.147176 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] HTTP exception thrown: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Request method failure captured: Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 HTTP/1.1 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTzRn__yZg8wvIQ1iRjnHRrlh9oKMrqEPaPh7MG6KVEwDeg_g2pdjuU8jVkr5MVuoBfQD6O_XqBzNFCzExIPQPVgFwRWSfFfMq3Hg_IzfOh_KgXlP8ZLPGMzyUt0nTkQ70fdOMkJNxZdwgpkgSMRfpzHsKO1XhQC8P5Gf_FGHPS0-k Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d4fefce7b59b4135ab03a518f381e171 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d4fefce7b59b4135ab03a518f381e171", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d4fefce7b59b4135ab03a518f381e171"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d4fefce7b59b4135ab03a518f381e171"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d4fefce7b59b4135ab03a518f381e171"}]}] Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d4fefce7b59b4135ab03a518f381e171 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1298122812 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersAdminNegativeTestJSON-1298122812-project Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 10f57760d0b5468b91c7b9666305dba9 Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1298122812-project Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '2ea316b7-8375-4c4b-b84a-73ba6b2f40f3'} Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:11.211106 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] Returning 404 to user: Instance 2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af4c8ba1-93ff-4acf-8efb-06e144bd0a73 tempest-ServersAdminNegativeTestJSON-1298122812 tempest-ServersAdminNegativeTestJSON-1298122812-project] 10.222.0.64 "GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3" status: 404 len: 111 microversion: 2.1 time: 0.098133 Nov 02 12:41:11.224674 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 619/1262] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/servers/2ea316b7-8375-4c4b-b84a-73ba6b2f40f3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:11.256406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: .version_select at 0x7eff5c269dc0>, body: {"server_group": {"name": "tempest-server-group-1949895730", "policies": ["affinity"]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:11.425706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:11.462690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:11.682746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:11.696694 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-160b07b8-dea3-45ed-9dbb-7c9dbc8a23b5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1317 microversion: 2.1 time: 1.315373 Nov 02 12:41:11.698753 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 644/1263] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:10 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1317 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:11.702761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:11.710462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-plugged", "status": "completed", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:11.718311 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:11.746966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.747358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.747811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.752743 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e6baaed5-99ae-4a11-a761-82456393e755 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.511777 Nov 02 12:41:11.762209 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 620/1264] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 12:41:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:11.776907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:11.779290 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] Creating event network-vif-plugged:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:41:11.781112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:11.799418 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-ba7c3569-0f60-4ce9-8fc2-0fb6b745edf7 req-b184bc0c-ca9b-4722-b7bb-c27d6fcc68bd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097393 Nov 02 12:41:11.808973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.812795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.814167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.817709 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 645/1265] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:11.820657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:11.822075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:11.823182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:11.871606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: .version_select at 0x7eff5c62d5e0>, body: {"server_group": {"name": "tempest-server-group-1949895730", "policies": ["affinity"]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:11.882335 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=100 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:12.002704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:12.032460 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:12.295925 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:12.310712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:12.334303 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:12.362448 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4138347a-3e1a-4ddf-ab90-5f16dca698e1 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.542400 Nov 02 12:41:12.369558 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f4035f22-1888-44da-b225-98d9381588c2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1268 microversion: 2.1 time: 0.593333 Nov 02 12:41:12.380942 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 621/1267] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:11 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1268 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:12.386525 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 646/1267] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 12:41:11 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:12.399579 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec17fedb-883d-4ac5-bf7b-23fe38c4e08a tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.618669 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ec17fedb-883d-4ac5-bf7b-23fe38c4e08a tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/77f9ff12-20f5-498a-a305-4eba21e469ad" status: 204 len: 0 microversion: 2.1 time: 0.226123 Nov 02 12:41:12.618669 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 622/1268] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:12 2022] DELETE /compute/v2.1/os-server-groups/77f9ff12-20f5-498a-a305-4eba21e469ad => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:12.626208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d627ad9-69c4-4835-aec6-cee7b6857bc2 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.658959 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d627ad9-69c4-4835-aec6-cee7b6857bc2 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.040901 Nov 02 12:41:12.664479 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 647/1269] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:12.684034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b30d4473-7a18-4a76-a619-20f4fff0a346 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.725883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.727377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:12.736933 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:12.760907 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.769859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.770734 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.771983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:12.772880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:12.773675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:12.869802 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b30d4473-7a18-4a76-a619-20f4fff0a346 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c" status: 204 len: 0 microversion: 2.1 time: 0.195416 Nov 02 12:41:12.870783 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 623/1270] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:12 2022] DELETE /compute/v2.1/os-server-groups/7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:12.880349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-002e66f5-f8a9-412b-b900-4e726c8d65be tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:12.924569 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-002e66f5-f8a9-412b-b900-4e726c8d65be tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040605 Nov 02 12:41:12.927902 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 624/1271] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:12.952749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: .version_select at 0x7eff5c269820>, body: {"server_group": {"name": "tempest-server-group-353627708", "policies": ["affinity"]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:12.996451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:13.009224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:13.194747 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:13.231606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:13.273905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:13.312958 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fac2e54f-7022-40e6-bc84-a1d9b5e92cf4 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.377139 Nov 02 12:41:13.335537 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 625/1272] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 12:41:12 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:13.344329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5a6d30d5-1fd5-4182-a39f-b61a22bfde8a tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:13.585198 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5a6d30d5-1fd5-4182-a39f-b61a22bfde8a tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/03b95b9d-3af1-4160-b9b2-45798a66cb31" status: 204 len: 0 microversion: 2.1 time: 0.237595 Nov 02 12:41:13.585198 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 626/1273] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:13 2022] DELETE /compute/v2.1/os-server-groups/03b95b9d-3af1-4160-b9b2-45798a66cb31 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:13.596178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:13.597127 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:13.627987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.629822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.630393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:13.632351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:13.633349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:13.634363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:13.710554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:13.739370 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f43e209c-8d97-4ad9-9067-3549b636525e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1317 microversion: 2.1 time: 1.019910 Nov 02 12:41:13.745724 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 648/1274] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:12 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:13.763735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5699b41e-4b8c-4bbd-a504-7803bd644f7d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:13.785765 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5699b41e-4b8c-4bbd-a504-7803bd644f7d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038653 Nov 02 12:41:13.793403 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 649/1275] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:41:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:13.804963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: .version_select at 0x7eff5c1df700>, body: {"server_group": {"name": "tempest-server-group-1435585201", "policies": ["anti-affinity"]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:13.845783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:13.863477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:13.879489 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:13.888230 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-61fe6fee-a15b-4d73-9b8f-a89327cb465c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1274 microversion: 2.1 time: 0.310560 Nov 02 12:41:13.904462 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 627/1276] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:13 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1274 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:14.152000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:14.161455 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Getting quotas for user 5ad02f7d8d7d43fb82270c0541c2343b and project f3fd137af33941589ef15699c4d59ffc. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:14.193831 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bbf11355-60f0-4800-bd74-9560cdaf97c7 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.392035 Nov 02 12:41:14.195635 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 650/1277] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 12:41:13 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:14.208932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6505e861-d258-42c3-a5d8-f239a3c49e19 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:14.357039 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6505e861-d258-42c3-a5d8-f239a3c49e19 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/e426f535-4391-443c-a323-7a6a9ae9d9fc" status: 204 len: 0 microversion: 2.1 time: 0.153629 Nov 02 12:41:14.361753 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 628/1278] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:14 2022] DELETE /compute/v2.1/os-server-groups/e426f535-4391-443c-a323-7a6a9ae9d9fc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:14.406657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-538aab8b-e73b-4412-bb75-28d77300eb5e tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:14.450137 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-538aab8b-e73b-4412-bb75-28d77300eb5e tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.074162 Nov 02 12:41:14.453074 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 651/1279] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:41:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:14.772081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:14.772789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:14.783052 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.783562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.784735 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-243674911", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "3de17bbf-e67f-420f-8298-27185c97fc74"}]}, "os:scheduler_hints": {"group": "aab1155b-13cd-466b-b0a4-9f6f8db351bc"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:14.784900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.784900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:14.785308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:14.785739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:14.964933 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] validate_networks() for [('3de17bbf-e67f-420f-8298-27185c97fc74', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3c81128-56f0-48c6-bb91-df7be54d20a5) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:16.106572 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3c81128-56f0-48c6-bb91-df7be54d20a5) Nov 02 12:41:16.112151 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.117145 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:16.117145 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Request method failure captured: Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 277 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVkLaXlE6EEM_aaJVRGJF4l_iMd6Lt_wUFLzRfU92ln-0Fj3AYIgkgm4D9i8HBdNettJc1Fg9LvJHTCXM7XEh9-cJOUojMShZleCxWhSdyHHZilak7WV4FNmHhsWFC_sqtP-UK6PAq8Svej-MYumxG_l6Nh5EhJqKVM-Ix5gNmlLfw Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f3fd137af33941589ef15699c4d59ffc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}] Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 5ad02f7d8d7d43fb82270c0541c2343b Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerGroupTestJSON-server-243674911", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "3de17bbf-e67f-420f-8298-27185c97fc74"}]}, "os:scheduler_hints": {"group": "aab1155b-13cd-466b-b0a4-9f6f8db351bc"}} Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerGroupTestJSON-server-243674911', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '3de17bbf-e67f-420f-8298-27185c97fc74'}]}, 'os:scheduler_hints': {'group': 'aab1155b-13cd-466b-b0a4-9f6f8db351bc'}}} Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:16.120403 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3c81128-56f0-48c6-bb91-df7be54d20a5) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.126034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1d6089c1-3ce8-4dd6-aea9-d69d29ce558f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.390843 Nov 02 12:41:16.147288 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 629/1280] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1395 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:16.157576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.158808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:16.183928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.184679 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.185267 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.186082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:16.188359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:16.189010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:16.431174 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:16.445586 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:16.458348 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6ba6e9b1-2314-4cfd-8e73-144d771d9812 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1274 microversion: 2.1 time: 0.320925 Nov 02 12:41:16.459140 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 630/1281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:16.468073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d79c170d-5c76-4551-92ed-c99d33a3df7c tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.480160 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8f7188d3-91de-45fd-9081-251aa6f2561e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1317 microversion: 2.1 time: 1.712485 Nov 02 12:41:16.483811 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 652/1282] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:14 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1317 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:16.590462 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d79c170d-5c76-4551-92ed-c99d33a3df7c tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.096055 Nov 02 12:41:16.594945 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 631/1283] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:16.609523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-df9d1704-e41b-4e91-8089-d52b462a096d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.638849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-df9d1704-e41b-4e91-8089-d52b462a096d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups/aab1155b-13cd-466b-b0a4-9f6f8db351bc" status: 200 len: 184 microversion: 2.1 time: 0.029709 Nov 02 12:41:16.640791 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 653/1284] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:41:16 2022] GET /compute/v2.1/os-server-groups/aab1155b-13cd-466b-b0a4-9f6f8db351bc => generated 184 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:16.659462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fcd39688-5b5c-40a9-ab6d-67b404de2377 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.679632 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-fcd39688-5b5c-40a9-ab6d-67b404de2377 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] HTTP exception thrown: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fcd39688-5b5c-40a9-ab6d-67b404de2377 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Request method failure captured: Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-server-groups/e426f535-4391-443c-a323-7a6a9ae9d9fc HTTP/1.1 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVkLaXlE6EEM_aaJVRGJF4l_iMd6Lt_wUFLzRfU92ln-0Fj3AYIgkgm4D9i8HBdNettJc1Fg9LvJHTCXM7XEh9-cJOUojMShZleCxWhSdyHHZilak7WV4FNmHhsWFC_sqtP-UK6PAq8Svej-MYumxG_l6Nh5EhJqKVM-Ix5gNmlLfw Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f3fd137af33941589ef15699c4d59ffc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}] Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 5ad02f7d8d7d43fb82270c0541c2343b Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e426f535-4391-443c-a323-7a6a9ae9d9fc'} Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.696161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fcd39688-5b5c-40a9-ab6d-67b404de2377 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Returning 404 to user: Instance group e426f535-4391-443c-a323-7a6a9ae9d9fc could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fcd39688-5b5c-40a9-ab6d-67b404de2377 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/e426f535-4391-443c-a323-7a6a9ae9d9fc" status: 404 len: 117 microversion: 2.1 time: 0.048094 Nov 02 12:41:16.708684 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 632/1285] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/os-server-groups/e426f535-4391-443c-a323-7a6a9ae9d9fc => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:16.716186 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c695b311-a021-4a62-b3a5-0159f06a533d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.732348 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c695b311-a021-4a62-b3a5-0159f06a533d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] HTTP exception thrown: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c695b311-a021-4a62-b3a5-0159f06a533d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Request method failure captured: Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-server-groups/03b95b9d-3af1-4160-b9b2-45798a66cb31 HTTP/1.1 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVkLaXlE6EEM_aaJVRGJF4l_iMd6Lt_wUFLzRfU92ln-0Fj3AYIgkgm4D9i8HBdNettJc1Fg9LvJHTCXM7XEh9-cJOUojMShZleCxWhSdyHHZilak7WV4FNmHhsWFC_sqtP-UK6PAq8Svej-MYumxG_l6Nh5EhJqKVM-Ix5gNmlLfw Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f3fd137af33941589ef15699c4d59ffc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}] Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5ad02f7d8d7d43fb82270c0541c2343b Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '03b95b9d-3af1-4160-b9b2-45798a66cb31'} Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.737597 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. Nov 02 12:41:16.747487 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.752606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c695b311-a021-4a62-b3a5-0159f06a533d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Returning 404 to user: Instance group 03b95b9d-3af1-4160-b9b2-45798a66cb31 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.752606 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c695b311-a021-4a62-b3a5-0159f06a533d tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/03b95b9d-3af1-4160-b9b2-45798a66cb31" status: 404 len: 117 microversion: 2.1 time: 0.042078 Nov 02 12:41:16.752606 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 654/1286] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/os-server-groups/03b95b9d-3af1-4160-b9b2-45798a66cb31 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:41:16.765310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0be1e805-4c63-4889-a01e-a8350368fc2f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.775206 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0be1e805-4c63-4889-a01e-a8350368fc2f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] HTTP exception thrown: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0be1e805-4c63-4889-a01e-a8350368fc2f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Request method failure captured: Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-server-groups/7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c HTTP/1.1 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVkLaXlE6EEM_aaJVRGJF4l_iMd6Lt_wUFLzRfU92ln-0Fj3AYIgkgm4D9i8HBdNettJc1Fg9LvJHTCXM7XEh9-cJOUojMShZleCxWhSdyHHZilak7WV4FNmHhsWFC_sqtP-UK6PAq8Svej-MYumxG_l6Nh5EhJqKVM-Ix5gNmlLfw Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f3fd137af33941589ef15699c4d59ffc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}] Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 5ad02f7d8d7d43fb82270c0541c2343b Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c'} Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.777523 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0be1e805-4c63-4889-a01e-a8350368fc2f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Returning 404 to user: Instance group 7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0be1e805-4c63-4889-a01e-a8350368fc2f tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c" status: 404 len: 117 microversion: 2.1 time: 0.023219 Nov 02 12:41:16.790112 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 633/1287] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/os-server-groups/7aecd1b4-ccd8-4f01-be3d-15e19f2b4c8c => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:16.797360 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-38da1dde-5b17-4ba0-8c8e-4d0174564c06 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:16.819856 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-38da1dde-5b17-4ba0-8c8e-4d0174564c06 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] HTTP exception thrown: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-38da1dde-5b17-4ba0-8c8e-4d0174564c06 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Request method failure captured: Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-server-groups/77f9ff12-20f5-498a-a305-4eba21e469ad HTTP/1.1 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmVkLaXlE6EEM_aaJVRGJF4l_iMd6Lt_wUFLzRfU92ln-0Fj3AYIgkgm4D9i8HBdNettJc1Fg9LvJHTCXM7XEh9-cJOUojMShZleCxWhSdyHHZilak7WV4FNmHhsWFC_sqtP-UK6PAq8Svej-MYumxG_l6Nh5EhJqKVM-Ix5gNmlLfw Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f3fd137af33941589ef15699c4d59ffc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f3fd137af33941589ef15699c4d59ffc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f3fd137af33941589ef15699c4d59ffc"}]}] Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f3fd137af33941589ef15699c4d59ffc Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerGroupTestJSON-1904491548 Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 5ad02f7d8d7d43fb82270c0541c2343b Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerGroupTestJSON-1904491548-project Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '77f9ff12-20f5-498a-a305-4eba21e469ad'} Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.825014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-38da1dde-5b17-4ba0-8c8e-4d0174564c06 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Returning 404 to user: Instance group 77f9ff12-20f5-498a-a305-4eba21e469ad could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-38da1dde-5b17-4ba0-8c8e-4d0174564c06 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/77f9ff12-20f5-498a-a305-4eba21e469ad" status: 404 len: 117 microversion: 2.1 time: 0.039855 Nov 02 12:41:16.834361 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 655/1288] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/os-server-groups/77f9ff12-20f5-498a-a305-4eba21e469ad => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:16.857453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a413adff-64ff-4802-ab16-304079c76243 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.058699 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a413adff-64ff-4802-ab16-304079c76243 tempest-ServerGroupTestJSON-1904491548 tempest-ServerGroupTestJSON-1904491548-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/aab1155b-13cd-466b-b0a4-9f6f8db351bc" status: 204 len: 0 microversion: 2.1 time: 0.221101 Nov 02 12:41:17.059995 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 634/1289] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:41:16 2022] DELETE /compute/v2.1/os-server-groups/aab1155b-13cd-466b-b0a4-9f6f8db351bc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:17.490156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.490156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:17.501614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.512651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:17.514765 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:17.522601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.528334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.536538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.541456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.541456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.541456 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.549359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.556162 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:17.566067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:17.572460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:17.577182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:18.294033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:19.093539 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:19.138679 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fb6dafcf-03c9-4306-9282-533d86be3d16 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 1.656980 Nov 02 12:41:19.140306 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 656/1290] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:17 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:19.257362 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:19.295423 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fd57a2d8-24d5-489f-b306-4506688a5e51 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1467 microversion: 2.1 time: 1.785657 Nov 02 12:41:19.297470 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 635/1291] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:17 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1467 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:19.334485 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-420201186"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:19.350927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:19.377172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.378615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.382473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:19.382473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:19.382473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:19.392713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.187755 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.189400 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:20.215329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.216203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.254889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.256300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:20.257277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:20.258060 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:20.415735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:20.568624 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7174273c-54b5-4bfa-bfe2-b7d971576deb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "POST /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435/action" status: 202 len: 0 microversion: 2.1 time: 1.241710 Nov 02 12:41:20.570608 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 657/1292] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:41:19 2022] POST /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435/action => generated 0 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:41:20.590080 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2de791a4-57a9-4e40-9140-12e61bd3efc1 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4ee820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:20.774948 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2de791a4-57a9-4e40-9140-12e61bd3efc1 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.193275 Nov 02 12:41:20.775926 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 658/1293] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:21.827307 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d0de8599-ca76-4406-8de3-4eeea42f508d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c476a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:21.947511 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d0de8599-ca76-4406-8de3-4eeea42f508d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.127165 Nov 02 12:41:21.947511 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 659/1294] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:22.481089 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.496001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.498758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.498758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.499290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.500385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.501399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.582421 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cdc8538c-713a-4226-abf5-ccbef2887ded tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.612958 Nov 02 12:41:22.584253 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 660/1295] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:41:21 2022] GET /compute/v2.1/os-services => generated 944 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:22.605329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.622572 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.625900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.625900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.627593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.628777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.631174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.677483 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7264e06f-aa01-430b-8b0a-080e2c9ad38e tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.075588 Nov 02 12:41:22.698519 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 661/1296] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:22.709178 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.719718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.726454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.726454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.726454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.726454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.726454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.773674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:22.802826 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8893cc97-c8be-4de9-bb5f-e45794c100f6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 2.632928 Nov 02 12:41:22.804533 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 636/1297] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:20 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 2636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:22.834239 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7cda1078-3ddf-4ac3-9705-66e749a2dfeb tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.133662 Nov 02 12:41:22.852645 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 662/1298] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/os-services => generated 944 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:22.876250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:22.900007 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.901967 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.904002 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.906957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:22.907944 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:22.908948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:22.970786 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e314056-145e-4686-a3b7-2158696bd36c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1dfee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.007359 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a17c2bcc-ed01-4116-a555-5ab2523bd9de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?host=n-d-857339-6&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.142007 Nov 02 12:41:23.024564 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 637/1299] 10.222.0.64 () {58 vars in 1194 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/os-services?host=n-d-857339-6&binary=xxx => generated 16 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:41:23.046475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.071482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.073415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.074232 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.075495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.076355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.099140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.099460 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e314056-145e-4686-a3b7-2158696bd36c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.131651 Nov 02 12:41:23.099460 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 663/1300] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:22 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:23.145391 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a7d93603-f42d-4df7-8024-f948cf6089de tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.111832 Nov 02 12:41:23.146319 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 638/1301] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/os-services => generated 944 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:23.186712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.194852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.199531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.203066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.204150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.205645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.208779 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.280909 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dc77b1aa-f566-482b-8c09-c3d0daa39e63 tempest-ServicesAdminNegativeTestJSON-1050764262 tempest-ServicesAdminNegativeTestJSON-1050764262-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.103460 Nov 02 12:41:23.282300 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 664/1302] 10.222.0.64 () {58 vars in 1198 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:41:23.300126 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=26 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:23.462520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c033efb-fdb4-4b0e-8da4-66f022ad5d1c", "tag": "f6a28c90-4c20-4523-ad16-8dc19c482ea1"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:23.488047 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.492886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.494568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.537023 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] Creating event network-changed:f6a28c90-4c20-4523-ad16-8dc19c482ea1 for instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c on n-h1-857339-6 Nov 02 12:41:23.548581 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-0f65f670-5ba9-4673-aaba-336e53e7d64b req-cc76e20d-34c6-4cb6-8f20-9714c1d93886 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090811 Nov 02 12:41:23.549926 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 665/1303] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:23.632179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80061281-6a41-4f22-8279-f841e4199e4c tempest-ServicesAdminNegativeTestJSON-48142854 tempest-ServicesAdminNegativeTestJSON-48142854-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.637928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-80061281-6a41-4f22-8279-f841e4199e4c tempest-ServicesAdminNegativeTestJSON-48142854 tempest-ServicesAdminNegativeTestJSON-48142854-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '069ee22251c74cfa86cbe02fbcf03346', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149e020732344f539f974bd3fb3d4f41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80061281-6a41-4f22-8279-f841e4199e4c tempest-ServicesAdminNegativeTestJSON-48142854 tempest-ServicesAdminNegativeTestJSON-48142854-project] Request method failure captured: Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmVvcGZ4k-C7guPpKmNMkP6nnu6C9JUPJX4IIJdMQVcW6N7k_pl6qzEQnbi5hPMGR2tGzeL4xvm-37Tw8Dx5tLn-bYO8nhbyHu7yuC0nkXZV75X4wJlIIzoS_DCkNMN8oIZ8v9OkTaqbHF9XLOiBn2B0HJIwUEMK5MKfqSmJo15myXU Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 149e020732344f539f974bd3fb3d4f41 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-48142854 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_149e020732344f539f974bd3fb3d4f41", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/149e020732344f539f974bd3fb3d4f41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/149e020732344f539f974bd3fb3d4f41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/149e020732344f539f974bd3fb3d4f41"}]}] Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-48142854 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 149e020732344f539f974bd3fb3d4f41 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-48142854 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServicesAdminNegativeTestJSON-48142854-project Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 069ee22251c74cfa86cbe02fbcf03346 Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-48142854-project Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:23.644429 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:23.653732 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:23.656979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-80061281-6a41-4f22-8279-f841e4199e4c tempest-ServicesAdminNegativeTestJSON-48142854 tempest-ServicesAdminNegativeTestJSON-48142854-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:23.658235 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-80061281-6a41-4f22-8279-f841e4199e4c tempest-ServicesAdminNegativeTestJSON-48142854 tempest-ServicesAdminNegativeTestJSON-48142854-project] 10.222.0.64 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.366774 Nov 02 12:41:23.659070 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 639/1304] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 368 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:41:23.859177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:23.865206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:23.917761 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.921704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.928668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:23.931103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:23.932683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:23.941488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:24.119189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0e10f3e2-2782-4b80-bf93-77d41914240b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2aae50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:24.178958 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=24 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:24.292692 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0e10f3e2-2782-4b80-bf93-77d41914240b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.184882 Nov 02 12:41:24.294172 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 640/1305] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:24 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:25.304323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:25.319734 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-29b560a4-871a-4667-b113-083843f18c26 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 1.468871 Nov 02 12:41:25.321238 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 666/1306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:23 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:25.321382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb4d7fc2-b3aa-423a-a333-fe30cbe928fd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c269820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:25.559451 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb4d7fc2-b3aa-423a-a333-fe30cbe928fd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.252177 Nov 02 12:41:25.560397 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 641/1307] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:25 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:26.174533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f370f285-63e4-4eb3-8f66-5fec8499f7b0 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Action: 'create', calling method: .version_select at 0x7eff5c239670>, body: {"pool": null} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:26.379258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:26.379888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:26.398189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.399000 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.402586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:26.409422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:26.410320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:26.411080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.635991 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:28.701235 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c2123c82-29b8-4d91-a06b-836959a07d14 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 2.330539 Nov 02 12:41:28.720534 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 642/1308] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:26 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:28.746123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cb10b7f4-d324-4d7b-b08e-5327b194a48d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.912608 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cb10b7f4-d324-4d7b-b08e-5327b194a48d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.197780 Nov 02 12:41:28.912608 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 643/1309] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:29.766005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:29.770209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:29.801949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.804560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.804560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:29.805423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.806592 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.809435 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.138512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:32.206537 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57d6e608-a989-4086-a0d1-3dbe916951a0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 2.444890 Nov 02 12:41:32.217098 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 644/1310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:29 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:32.248251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cc502579-abe7-476d-92ba-7e13d47a937e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2693a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:32.394681 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cc502579-abe7-476d-92ba-7e13d47a937e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.173499 Nov 02 12:41:32.417504 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 645/1311] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:32 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:32.440173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-plugged", "status": "completed", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:32.481915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.484187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.487528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.550273 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] Creating event network-vif-plugged:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:41:32.577288 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-8c72ef2b-41cf-4ace-9e06-63f141ed06dc req-260f100a-be9b-4faf-81d7-bd32f381fe3b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154327 Nov 02 12:41:32.581088 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 646/1312] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:33.237025 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:33.246983 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:33.259883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:33.277328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:33.285015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.286040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.288230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:33.291487 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.294499 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.298337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:33.713643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:33.726474 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a105ab44-2fbd-431b-b2d0-7caf6c327cf2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 0.489949 Nov 02 12:41:33.743133 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 647/1313] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:33 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:33.754262 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-016256ab-39f8-4225-bed7-c48165c9f133 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c269d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:33.859664 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-016256ab-39f8-4225-bed7-c48165c9f133 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.115152 Nov 02 12:41:33.860525 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 648/1314] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:33 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:33.887055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:34.512966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-18776951", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "2ee5fd2c-acea-4121-9a5a-7f1d6e1118d9"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:34.663878 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] validate_networks() for [('2ee5fd2c-acea-4121-9a5a-7f1d6e1118d9', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:35.310389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=16 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:36.575544 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6) Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:36.585664 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] Request method failure captured: Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 215 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmV9XNg-1wUR_9tb2V5nUi3ps7bp5N41AEI5h-DP8BMQZbpLlij-sJbHaScm58LE-Scb0rK2YpN8cOTeNcAmrLyt7uhM_yTqTPXUgwGcgdzaqhIwhXUhbgnZClMxPv2AZ9n7Iw2jUVOwxdduyyOIAVttqLdwoBvad0KBVi9GnThGTrM Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: c7ac1379307745cebba3fb9757ca990b Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2051564705 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c7ac1379307745cebba3fb9757ca990b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c7ac1379307745cebba3fb9757ca990b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c7ac1379307745cebba3fb9757ca990b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c7ac1379307745cebba3fb9757ca990b"}]}] Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2051564705 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: c7ac1379307745cebba3fb9757ca990b Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2051564705 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerAddressesNegativeTestJSON-2051564705-project Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 131bac915e2f483ebd6c54464431f8a3 Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2051564705-project Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-18776951", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "2ee5fd2c-acea-4121-9a5a-7f1d6e1118d9"}]}} Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesNegativeTestJSON-server-18776951', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '2ee5fd2c-acea-4121-9a5a-7f1d6e1118d9'}]}}} Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:41:36.608372 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-124276ea-0ae2-495d-b2a5-50a2f0f8a7f6) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:41:36.619154 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.638196 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:36.650990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:41:36.650990 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:36.662744 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-48b10f1e-2f07-4b93-bd78-e9d6f00cbf7d tempest-ServerAddressesNegativeTestJSON-2051564705 tempest-ServerAddressesNegativeTestJSON-2051564705-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.784242 Nov 02 12:41:36.679966 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 649/1315] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 2813 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:41:36.707909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:36.715023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:36.786665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.793413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.796183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.798581 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.803336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.804693 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.887510 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:39.903464 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2432dbc8-3e18-48a5-ba89-4fde73550362 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 3.224790 Nov 02 12:41:39.904225 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 650/1316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:36 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 3227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:39.929635 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8003096a-933e-4148-bc9f-25196b5b5d41 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5cf693a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:40.048176 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8003096a-933e-4148-bc9f-25196b5b5d41 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.140470 Nov 02 12:41:40.055467 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 651/1317] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:40.068152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c033efb-fdb4-4b0e-8da4-66f022ad5d1c", "name": "network-vif-plugged", "status": "completed", "tag": "f6a28c90-4c20-4523-ad16-8dc19c482ea1"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:40.111347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.115958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.115958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.151830 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] Creating event network-vif-plugged:f6a28c90-4c20-4523-ad16-8dc19c482ea1 for instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c on n-h1-857339-6 Nov 02 12:41:40.184366 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-35ea1b27-56d3-4e7d-9c4e-a32e51a8bb93 req-fae8eeb8-6ab5-4a10-a8e9-87f7b4292aa1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127165 Nov 02 12:41:40.185321 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 652/1318] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:40.933023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:40.940291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:40.967112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.976506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.978658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.979573 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.980071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.983416 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.737652 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f370f285-63e4-4eb3-8f66-5fec8499f7b0 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 15.898425 Nov 02 12:41:41.741215 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 667/1319] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:41:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 15903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:41.747817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-64dc3869-0d51-4886-8477-4bc416eade53 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c516040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:42.011756 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-64dc3869-0d51-4886-8477-4bc416eade53 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.261959 Nov 02 12:41:42.026863 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 668/1320] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:41 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:42.035114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3f7e4f65-fdaa-4b54-88aa-034ee45b2edd tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Action: 'create', calling method: .version_select at 0x7eff5c1dfd30>, body: {"pool": null} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:42.382367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:42.382367 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-787f27d3-4472-42b9-be09-671b885e6f34 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 1.454700 Nov 02 12:41:42.382367 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 653/1321] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:40 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:42.683616 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c5c21f0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:42.704168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.705191 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.705856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.722560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.723480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] HTTP exception thrown: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Request method failure captured: Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 HTTP/1.1 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 56 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWFblDNMtx0XUCrXb9pM63PTnVeiJT6ypuuSz07LYx27QqM9mIESo-OjAr9EU5p1NlCj4KWVW5pLnkKcgVl_uZmQ0bptuZwS6Vw92o2DVKoH6pus387iJtfxLJp1c3IUmPj8l4LxbAD6OKgqgfVXicQwWQZkmKI2dZw_h4zenevWHk Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a6ed628773db4cc6acbec7035f929a64", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}] Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7db8a54125ff468da190be72312c8a3e Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: {"status": "disabled", "disabled_reason": "maintenance"} Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: exception: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '358c7f51-9629-4a36-9b45-6a8c480f1b68', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.744858 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Returning 404 to user: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6ceca0b1-8d99-440a-b2e7-48bef882b30f tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68" status: 404 len: 110 microversion: 2.53 time: 0.356147 Nov 02 12:41:42.752231 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 654/1322] 10.222.0.64 () {62 vars in 1309 bytes} [Wed Nov 2 12:41:42 2022] PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 => generated 110 bytes in 357 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:41:42.770512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c27a820>, body: {"status": "disabled"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:42.786274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.787225 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.787904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.796345 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.797268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.797913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.807440 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] HTTP exception thrown: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Request method failure captured: Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 HTTP/1.1 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 22 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWFblDNMtx0XUCrXb9pM63PTnVeiJT6ypuuSz07LYx27QqM9mIESo-OjAr9EU5p1NlCj4KWVW5pLnkKcgVl_uZmQ0bptuZwS6Vw92o2DVKoH6pus387iJtfxLJp1c3IUmPj8l4LxbAD6OKgqgfVXicQwWQZkmKI2dZw_h4zenevWHk Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a6ed628773db4cc6acbec7035f929a64", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}] Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7db8a54125ff468da190be72312c8a3e Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: {"status": "disabled"} Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: exception: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '358c7f51-9629-4a36-9b45-6a8c480f1b68', 'body': {'status': 'disabled'}} Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:42.809957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.815849 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.837483 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Returning 404 to user: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:42.837483 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-46944411-ffa3-4458-82a4-d31299303a79 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68" status: 404 len: 110 microversion: 2.53 time: 0.076548 Nov 02 12:41:42.837483 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 655/1323] 10.222.0.64 () {62 vars in 1309 bytes} [Wed Nov 2 12:41:42 2022] PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:41:42.845472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Action: 'update', calling method: .version_select at 0x7eff5c274ee0>, body: {"status": "enabled"} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:42.853282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.854116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.854894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.870091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.893626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.902575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.918645 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] HTTP exception thrown: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Request method failure captured: Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: request: PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 HTTP/1.1 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 21 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWFblDNMtx0XUCrXb9pM63PTnVeiJT6ypuuSz07LYx27QqM9mIESo-OjAr9EU5p1NlCj4KWVW5pLnkKcgVl_uZmQ0bptuZwS6Vw92o2DVKoH6pus387iJtfxLJp1c3IUmPj8l4LxbAD6OKgqgfVXicQwWQZkmKI2dZw_h4zenevWHk Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a6ed628773db4cc6acbec7035f929a64", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a6ed628773db4cc6acbec7035f929a64"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a6ed628773db4cc6acbec7035f929a64"}]}] Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a6ed628773db4cc6acbec7035f929a64 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623 Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7db8a54125ff468da190be72312c8a3e Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: {"status": "enabled"} Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: exception: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '358c7f51-9629-4a36-9b45-6a8c480f1b68', 'body': {'status': 'enabled'}} Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:41:42.924302 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. Nov 02 12:41:42.939581 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:42.963263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Returning 404 to user: Service 358c7f51-9629-4a36-9b45-6a8c480f1b68 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:42.968419 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a488641c-4ed8-4ef3-bb1c-d500f232b144 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68" status: 404 len: 110 microversion: 2.53 time: 0.125751 Nov 02 12:41:42.971609 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 656/1324] 10.222.0.64 () {62 vars in 1309 bytes} [Wed Nov 2 12:41:42 2022] PUT /compute/v2.1/os-services/358c7f51-9629-4a36-9b45-6a8c480f1b68 => generated 110 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:41:42.988792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.011773 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.014589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.025143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.025143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.025143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.025143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.080201 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fe5cb6f1-1fb1-458a-9ad4-dec6aff24b17 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.101784 Nov 02 12:41:43.081624 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 657/1325] 10.222.0.64 () {60 vars in 1178 bytes} [Wed Nov 2 12:41:42 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:43.101441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c27adae0-f74b-4496-86ef-34710c5146eb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27a9d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.230371 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c27adae0-f74b-4496-86ef-34710c5146eb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.136511 Nov 02 12:41:43.238945 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 658/1326] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:43 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:43.277290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.297932 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.304924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.313105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.314152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.314705 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.315157 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.351910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=74 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:43.422072 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0be20c52-0c11-487d-855f-bfb27742d922 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.181667 Nov 02 12:41:43.423534 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 659/1327] 10.222.0.64 () {60 vars in 1211 bytes} [Wed Nov 2 12:41:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:43.449356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.450355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:43.466907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.472251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.472251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.472251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.472251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.472938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.324615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:44.344035 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-56012fe5-0c3f-4fac-93de-0f2e452dbadf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1316 microversion: 2.1 time: 0.899340 Nov 02 12:41:44.345607 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 660/1328] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:43 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1316 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.352304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.367985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.374931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.374931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.377274 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.378167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.379604 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.465279 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bb0f2032-798a-495a-83fe-c813c921a9c2 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.115852 Nov 02 12:41:44.477968 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 661/1329] 10.222.0.64 () {60 vars in 1178 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:44.485076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c6d4e89-894f-4712-820f-8918200bea22 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.554112 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6c6d4e89-894f-4712-820f-8918200bea22 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.074456 Nov 02 12:41:44.556191 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 662/1330] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.562145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.569057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.570177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.571164 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.572414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.576791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.576791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.622938 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c011d16b-a930-4aa3-bd08-02a3121663f9 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?host=n-d-857339-6&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.064248 Nov 02 12:41:44.638560 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 663/1331] 10.222.0.64 () {60 vars in 1235 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/os-services?host=n-d-857339-6&binary=xxx => generated 16 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.644591 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.665516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.666235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.666568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.677014 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.677847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.678314 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.813045 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6ab3b156-4eba-45df-94ec-3e463dec3097 tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.169589 Nov 02 12:41:44.818992 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 664/1332] 10.222.0.64 () {60 vars in 1178 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:41:44.843683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.852849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.854177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.855311 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.857336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.858580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.860909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.976768 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-69eb0c19-66c5-4024-beda-8d459f1f4f9d tempest-ServicesAdminNegativeV253TestJSON-470358623 tempest-ServicesAdminNegativeV253TestJSON-470358623-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.148037 Nov 02 12:41:44.984623 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 665/1333] 10.222.0.64 () {60 vars in 1239 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:45.343244 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c1ccd4cf-81cf-47ef-8a0e-a937f5e06979 tempest-ServicesAdminNegativeV253TestJSON-1959756652 tempest-ServicesAdminNegativeV253TestJSON-1959756652-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:45.364177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c1ccd4cf-81cf-47ef-8a0e-a937f5e06979 tempest-ServicesAdminNegativeV253TestJSON-1959756652 tempest-ServicesAdminNegativeV253TestJSON-1959756652-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8bfaec7c926044ecba6fe31152467ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cecc7764f614cfa908d27412a113160', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c1ccd4cf-81cf-47ef-8a0e-a937f5e06979 tempest-ServicesAdminNegativeV253TestJSON-1959756652 tempest-ServicesAdminNegativeV253TestJSON-1959756652-project] Request method failure captured: Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-services HTTP/1.1 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWDWfYX_XLzRPUGReluZQjkMn3mkuF5R-CQwrg-EOm6--j4JMYIYphctKzYP6G1FEhAZqB--OMBvFfNWAXF1vK338jy3INNeaTalS4Sm3xI0BN7HfjfEzhmDvq48X5yIBreTDEtb9RBrqOSDTBZM8T4uUdRJyrT8RvH3xOC3ScNLTI Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.53 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 0cecc7764f614cfa908d27412a113160 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1959756652 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0cecc7764f614cfa908d27412a113160", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0cecc7764f614cfa908d27412a113160"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0cecc7764f614cfa908d27412a113160"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0cecc7764f614cfa908d27412a113160"}]}] Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1959756652 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 0cecc7764f614cfa908d27412a113160 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1959756652 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1959756652-project Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8bfaec7c926044ecba6fe31152467ec8 Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1959756652-project Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: action_args: {} Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.enforce( Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Nov 02 12:41:45.373296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:41:45.384851 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c1ccd4cf-81cf-47ef-8a0e-a937f5e06979 tempest-ServicesAdminNegativeV253TestJSON-1959756652 tempest-ServicesAdminNegativeV253TestJSON-1959756652-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:45.388333 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c1ccd4cf-81cf-47ef-8a0e-a937f5e06979 tempest-ServicesAdminNegativeV253TestJSON-1959756652 tempest-ServicesAdminNegativeV253TestJSON-1959756652-project] 10.222.0.64 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.389491 Nov 02 12:41:45.397181 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 666/1334] 10.222.0.64 () {60 vars in 1178 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/os-services => generated 112 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:41:45.428978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:45.430704 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:45.467317 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:45.477652 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:45.479299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:45.489733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:45.491221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:45.492333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.377332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:46.425649 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-395fe299-fa71-46e3-9ec7-f2751731d7ce tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1466 microversion: 2.1 time: 1.030109 Nov 02 12:41:46.427459 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 667/1335] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:45 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1466 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.443495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6dbfa2f9-8a24-4827-9dc8-c77129eb9a0b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:46.588172 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6dbfa2f9-8a24-4827-9dc8-c77129eb9a0b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.157549 Nov 02 12:41:46.605040 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 668/1336] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.620363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:46.623210 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:46.628813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=9 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:46.640763 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.642087 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.646677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.648306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.654360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.656018 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.242877 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9e7277e9-5e10-4221-952f-1f2b8145b9a1 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1617 microversion: 2.1 time: 1.613325 Nov 02 12:41:48.244094 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 669/1337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1617 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:48.315202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-966734b7-af03-4be3-8e73-99ab770e7ff5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27af70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:48.460097 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-966734b7-af03-4be3-8e73-99ab770e7ff5 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.181314 Nov 02 12:41:48.484404 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 670/1338] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:48 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:48.643020 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-401142011", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["48de1b1f-9d7e-41bf-b1e6-023d17cecc0e"]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:48.782725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:50.997028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:50.998342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:50.999830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:51.000443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:51.001063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:51.037024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.037859 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.038543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.039621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.040335 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.041194 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.067454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:51.074876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:51.098432 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:51.101114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:51.370697 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c4be1831-0b3b-4780-b4de-e68e7a163b45 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.742377 Nov 02 12:41:51.377578 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 671/1339] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:51.386287 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-09e16ab9-0c01-4f12-b12f-19a4ed7e799e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0dc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:51.436079 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3f7e4f65-fdaa-4b54-88aa-034ee45b2edd tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.407199 Nov 02 12:41:51.437522 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 669/1340] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:41:42 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:51.449883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bf08a899-a5ab-4ebc-8c06-3631e2586a3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:51.451027 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bf08a899-a5ab-4ebc-8c06-3631e2586a3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:51.504411 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-09e16ab9-0c01-4f12-b12f-19a4ed7e799e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.123360 Nov 02 12:41:51.519526 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 672/1341] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:51 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:51.548925 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-98daf1d4-9816-4093-893a-f4b99462df77 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Action: 'create', calling method: .version_select at 0x7eff5c1f0c10>, body: {"pool": null} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:51.786776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bf08a899-a5ab-4ebc-8c06-3631e2586a3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:51.835072 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bf08a899-a5ab-4ebc-8c06-3631e2586a3e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1216 microversion: 2.1 time: 0.395869 Nov 02 12:41:51.842537 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 670/1342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:51 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1216 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:52.523568 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a21e98e6-e503-4af8-ae17-47bb311aeebd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c45a0d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:52.635933 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a21e98e6-e503-4af8-ae17-47bb311aeebd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.116643 Nov 02 12:41:52.638158 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 671/1343] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:52 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:52.895810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6286f47e-a135-4e66-b43e-d098f02e13eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:52.895810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6286f47e-a135-4e66-b43e-d098f02e13eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:53.410336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6286f47e-a135-4e66-b43e-d098f02e13eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:53.441112 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6286f47e-a135-4e66-b43e-d098f02e13eb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1216 microversion: 2.1 time: 0.552806 Nov 02 12:41:53.441827 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 672/1344] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:52 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1216 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:53.657966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-21a568dc-1e89-4569-9100-78b1df0b09b9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4b6310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:53.797148 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-21a568dc-1e89-4569-9100-78b1df0b09b9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.145932 Nov 02 12:41:53.797148 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 673/1345] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:53 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:54.500248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:54.501708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:54.510745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:54.511926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:54.512649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:54.514229 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:54.514870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:54.516533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:54.955143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:54.967487 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7c4cf8b5-5443-46e8-917d-6aab197341e8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1220 microversion: 2.1 time: 0.479050 Nov 02 12:41:54.968083 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 674/1346] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:54 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1220 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:54.983608 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-84a593e1-786c-40fe-a2ad-898eec69527d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4b6c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:55.156412 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-84a593e1-786c-40fe-a2ad-898eec69527d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.181962 Nov 02 12:41:55.158490 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 675/1347] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:54 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:56.015150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:56.018248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:56.057113 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.058152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.058866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.059808 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:56.061108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:56.063069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:56.641203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:56.675205 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-290aa15b-cd5f-466c-b4a5-01e6874bba71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1268 microversion: 2.1 time: 0.665778 Nov 02 12:41:56.678569 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 676/1348] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:56 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1268 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:56.693199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-22a1204a-98c6-458f-8ab6-76a8f3d8e697 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4b6550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:56.821847 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-22a1204a-98c6-458f-8ab6-76a8f3d8e697 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.140592 Nov 02 12:41:56.826983 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 677/1349] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:56 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:57.600235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a66070c2-665a-4301-80db-e70a6276be41 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Action: 'create', calling method: .version_select at 0x7eff5c559af0>, body: {"keypair": {"name": "tempest-keypair-1664415755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnQ4AQuOdl8WQCqkesanpt41DGkm/1dF8/1dp57Bz719MH7qJeN9fDi+t1qKp9rLYJ/cbZ1bx8GoWagV4vvIYmEmziirHplPHN5k1teh8vUnY2Acdoo3aP25Hbj1kC3Yw=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:57.672598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a66070c2-665a-4301-80db-e70a6276be41 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Getting quotas for project a62e260bcc524f18b03a968bb631891d. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:57.692128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a66070c2-665a-4301-80db-e70a6276be41 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Getting quotas for user a826e2ebcf3a416ebbd0b2f00b314887 and project a62e260bcc524f18b03a968bb631891d. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:57.957810 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a66070c2-665a-4301-80db-e70a6276be41 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.733096 Nov 02 12:41:57.958964 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 678/1350] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:41:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:41:57.976708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:57.977855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:58.004631 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:58.005710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:58.006366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:58.007116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:58.007602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:58.008053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:58.188974 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:58.211542 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b63de792-f7a3-4377-b228-c300b7ada008 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1274 microversion: 2.1 time: 0.250662 Nov 02 12:41:58.213121 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 679/1351] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:57 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1274 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:58.263301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7f082869-77a4-44c1-89e0-a1ae5cd69ef7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:58.363204 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7f082869-77a4-44c1-89e0-a1ae5cd69ef7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.148053 Nov 02 12:41:58.364888 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 680/1352] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:58 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:59.246374 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:59.247828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:59.261036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.263840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.272016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.273396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:59.274373 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:59.275173 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:59.746066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:59.771098 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-acdc2d65-c3fb-4224-b74d-ceb34e6e8d04 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1274 microversion: 2.1 time: 0.521547 Nov 02 12:41:59.785295 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 681/1353] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:59 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1274 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:59.787915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1488acf2-10ec-4e79-b9b5-2d3218220195 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c45a9d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:59.900244 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1488acf2-10ec-4e79-b9b5-2d3218220195 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.122166 Nov 02 12:41:59.903745 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 682/1354] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:41:59 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:00.125733 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-98daf1d4-9816-4093-893a-f4b99462df77 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.602467 Nov 02 12:42:00.127590 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 673/1355] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:41:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:00.150437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a9508636-9d97-4132-87c9-ace4e3e7d34c tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Action: 'create', calling method: .version_select at 0x7eff5c476700>, body: {"pool": null} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:00.837669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:00.839563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:00.895092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.908929 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.912240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:00.915010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.916671 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.918345 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.052794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=20 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:01.088298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:01.267977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:01.284822 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7564c8e7-49bc-4841-bfff-ce53f9fe1797 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1274 microversion: 2.1 time: 0.480262 Nov 02 12:42:01.300794 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 674/1356] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:00 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1274 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:01.311704 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9c7dae00-313b-4c87-87b6-6949c6901751 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:01.443820 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9c7dae00-313b-4c87-87b6-6949c6901751 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1454 microversion: 2.1 time: 0.140762 Nov 02 12:42:01.463212 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 675/1357] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:01 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:02.326808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:02.331186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:02.371120 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.372599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.373737 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.377657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.389555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.389733 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.141203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:04.168035 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-541523c0-6fac-449c-baa9-d56ce890e237 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 1.849656 Nov 02 12:42:04.168035 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 676/1358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:02 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:04.178638 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-69eb7e79-8edd-4200-ad0f-d1cf7da374f4 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c38a550>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:04.283862 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-69eb7e79-8edd-4200-ad0f-d1cf7da374f4 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1463 microversion: 2.1 time: 0.123935 Nov 02 12:42:04.285454 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 677/1359] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:04 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1463 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:04.305738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-97cabcc7-a1cd-4f17-a7cd-5814bd76764c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27a940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:04.368843 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-97cabcc7-a1cd-4f17-a7cd-5814bd76764c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 200 len: 1463 microversion: 2.1 time: 0.070833 Nov 02 12:42:04.370225 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 678/1360] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:04 2022] GET /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 1463 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:04.393180 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:04.394997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:04.409801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.411462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.413623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:04.416799 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:04.418439 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:04.420147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.251123 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:05.301511 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5c16ef61-1397-46a3-83d6-7d88e3308d07 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1480 microversion: 2.1 time: 0.917719 Nov 02 12:42:05.302544 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 679/1361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:04 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1480 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:05.320634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:05.321310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:05.340255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.341636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.342735 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.344364 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:05.345517 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:05.346542 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:05.915726 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:05.926753 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7c9d4c39-960d-4a56-95ed-de91df1b5ab2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.611600 Nov 02 12:42:05.938673 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 680/1362] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:05 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:06.347341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:06.348379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:06.364098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.365051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.369011 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.370107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:06.370895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:06.373373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:06.948979 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:06.992965 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9ab6c7b5-a470-4b6e-bdeb-bc99dcff6386 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1467 microversion: 2.1 time: 0.651443 Nov 02 12:42:06.994223 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a9508636-9d97-4132-87c9-ace4e3e7d34c tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.847960 Nov 02 12:42:07.000275 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 681/1363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:06 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1467 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:07.006615 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 683/1364] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:42:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:07.015720 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0c4fa9a5-f08e-43ae-89be-3aa3daddd00f tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c261c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:07.020884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:07.022511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:07.047209 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.067980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.069320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.071009 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.072181 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.073359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.397799 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0c4fa9a5-f08e-43ae-89be-3aa3daddd00f tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips/93500c21-353f-47a6-9f12-1a0cf3d6fdd8" status: 200 len: 141 microversion: 2.1 time: 0.385892 Nov 02 12:42:07.406015 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 684/1365] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:42:07 2022] GET /compute/v2.1/os-floating-ips/93500c21-353f-47a6-9f12-1a0cf3d6fdd8 => generated 141 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:07.412429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1524760268"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:07.420393 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:07.436870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.437799 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.438913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.440118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:07.440947 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:07.441687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:07.664110 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:07.679487 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-72ecac1a-6da6-4327-9a3f-33ac6854fee5 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.676204 Nov 02 12:42:07.682726 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 682/1366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:07 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:07.698631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb0562d0-a1eb-4b2b-b5c3-a734f51d3c12 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c5c21f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:07.720750 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:08.493342 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0fc5edcb-ef80-4785-bda0-b6a30e88618a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "POST /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74/action" status: 202 len: 0 microversion: 2.1 time: 1.078324 Nov 02 12:42:08.493342 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 685/1367] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:07 2022] POST /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74/action => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:42:08.506858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66dc1c14-fc97-4b5e-b74c-dfba2e45b69e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c24ae50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:08.641751 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66dc1c14-fc97-4b5e-b74c-dfba2e45b69e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.142321 Nov 02 12:42:08.656554 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 686/1368] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:08 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:08.739387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:08.741518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:08.780837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.781510 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.784865 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:08.786959 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:08.787633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:08.789306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.616943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:09.688797 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca28beaa-9275-482c-b5c2-6b8a679d300b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.957463 Nov 02 12:42:09.691625 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 687/1369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:08 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:09.716791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a20af1-ba94-4459-8b9b-5f170a876caa", "tag": "d727cd98-7b6e-45c4-ba61-de6bced45d8d"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:09.755087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.758208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.759796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:09.833493 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] Creating event network-changed:d727cd98-7b6e-45c4-ba61-de6bced45d8d for instance c1a20af1-ba94-4459-8b9b-5f170a876caa on n-h1-857339-6 Nov 02 12:42:09.862386 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-4fd72a61-9538-483f-947e-e971ad93d0c3 req-0d19ddde-4716-43ab-9914-a46d81a02bbe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165061 Nov 02 12:42:09.866147 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 688/1370] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:09.899822 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-unplugged", "status": "completed", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:09.963358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:09.971357 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:09.972426 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.025729 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] Creating event network-vif-unplugged:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:42:10.042706 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-3085ed5f-7755-4457-bf43-6082a1e39c75 req-9245c1b8-593f-49a2-adc7-72e8475f68af service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171671 Nov 02 12:42:10.044354 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 689/1371] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:10.062685 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d1900a1d-bb3b-4d7d-9a83-32df9bc5f2ea tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c261a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:10.222396 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d1900a1d-bb3b-4d7d-9a83-32df9bc5f2ea tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.174012 Nov 02 12:42:10.225293 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 690/1372] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:10 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:10.742040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:10.749101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:10.793443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.799876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.803050 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:10.804429 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:10.805389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:10.806163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:11.167186 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb0562d0-a1eb-4b2b-b5c3-a734f51d3c12 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/93500c21-353f-47a6-9f12-1a0cf3d6fdd8" status: 202 len: 0 microversion: 2.1 time: 3.480523 Nov 02 12:42:11.175002 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 683/1373] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:07 2022] DELETE /compute/v2.1/os-floating-ips/93500c21-353f-47a6-9f12-1a0cf3d6fdd8 => generated 0 bytes in 3485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:11.187208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-736cc075-ee45-4ae9-8407-7c29c9c7276c tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c27a940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:11.635180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:11.650811 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cf86c4d0-7b3e-4f5f-9eff-01dc786776d8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.934220 Nov 02 12:42:11.656423 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 691/1374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:10 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:11.663198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20bf7f0c-abf1-4dd0-887a-cd39d2b3cab8 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c516c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:11.815682 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20bf7f0c-abf1-4dd0-887a-cd39d2b3cab8 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.158966 Nov 02 12:42:11.830979 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 692/1375] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:11 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:12.005344 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-736cc075-ee45-4ae9-8407-7c29c9c7276c tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.827873 Nov 02 12:42:12.006690 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 684/1376] 10.222.0.64 () {58 vars in 1164 bytes} [Wed Nov 2 12:42:11 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:42:12.025327 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d14ad42a-1c61-4c2e-993c-f5324d7fe893 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c261790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:12.698077 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:12.699226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:12.741071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:12.744884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:12.744884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:12.744884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:12.753040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:12.755127 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:13.300435 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:13.347844 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d14ad42a-1c61-4c2e-993c-f5324d7fe893 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 1.328253 Nov 02 12:42:13.355932 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ac188421-be43-4b95-9c11-b519bb895922 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.660847 Nov 02 12:42:13.358356 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 685/1377] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:12 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:13.363396 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 693/1378] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:42:12 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:13.371136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-afab5f06-776b-42aa-a5a5-f3a7e46d9f50 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c4b65e0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:13.393230 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c12be825-ade6-413f-83e8-608ceef5c366 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c214940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:13.514309 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c12be825-ade6-413f-83e8-608ceef5c366 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.153646 Nov 02 12:42:13.517447 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 686/1379] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:13 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:14.399402 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:14.401010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:14.417168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:14.427825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:14.430082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:14.431291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:14.433611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:14.436511 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:14.462295 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=72 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:16.210316 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:16.237513 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-007c87cb-002e-4795-a272-386d42f0735c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 1.842212 Nov 02 12:42:16.245996 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 687/1380] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:14 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:16.274610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5d29f958-1d50-4cdd-bd1c-e945977913f9"}], "security_groups": [{"name": "tempest-securitygroup--584579634"}], "key_name": "tempest-keypair-1664415755", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:16.570284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] validate_networks() for [('5d29f958-1d50-4cdd-bd1c-e945977913f9', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:17.972341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:18.018662 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf) Nov 02 12:42:18.027587 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.038219 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:18.038219 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Request method failure captured: Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 498 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWUXxvk8v7saNv3Dx6NJTZq1ezQF1EgYHIvA4sdlrMX6aZ4uz4PtfNJPFvGRnZn1HdA1ayjMbO6Fbif7Aac5SQ5LdacLvx0VJdOTKLGfTMF2GeGvyMXEn0xwjMASJq4h3220uPyCrAVdP88CFcGbiu_SWeZEp9H7Z6kWpn0IjMtJmc Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a62e260bcc524f18b03a968bb631891d Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersTestFqdnHostnames-512753941 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a62e260bcc524f18b03a968bb631891d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a62e260bcc524f18b03a968bb631891d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a62e260bcc524f18b03a968bb631891d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a62e260bcc524f18b03a968bb631891d"}]}] Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersTestFqdnHostnames-512753941 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a62e260bcc524f18b03a968bb631891d Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-512753941 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersTestFqdnHostnames-512753941-project Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: a826e2ebcf3a416ebbd0b2f00b314887 Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersTestFqdnHostnames-512753941-project Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "C2~wyHXs^QPX8vt", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "5d29f958-1d50-4cdd-bd1c-e945977913f9"}], "security_groups": [{"name": "tempest-securitygroup--584579634"}], "key_name": "tempest-keypair-1664415755", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'guest-instance-1.domain.com', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'C2~wyHXs^QPX8vt', 'networks': [{'uuid': '5d29f958-1d50-4cdd-bd1c-e945977913f9'}], 'security_groups': [{'name': 'tempest-securitygroup--584579634'}], 'key_name': 'tempest-keypair-1664415755', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:18.038888 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-47c203b7-bbd0-4ed2-97cd-a028346d8aaf) Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.056430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:18.082531 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7828208a-51f7-4886-a32f-f325b77b5ead tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.818175 Nov 02 12:42:18.090275 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 688/1381] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 1839 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:42:18.106196 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-305cc77f-2ce9-4b7a-8ada-69cba832bdb7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c3a3f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:18.261365 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-305cc77f-2ce9-4b7a-8ada-69cba832bdb7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.168291 Nov 02 12:42:18.264705 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 689/1382] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:18 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:18.292257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:18.294325 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:18.320119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.326931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.328807 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.330626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:18.333714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:18.338633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:18.741943 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-afab5f06-776b-42aa-a5a5-f3a7e46d9f50 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/3667478b-be00-4ef6-89b1-1dd96f80ea9d" status: 202 len: 0 microversion: 2.1 time: 5.376773 Nov 02 12:42:18.742550 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 694/1383] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:13 2022] DELETE /compute/v2.1/os-floating-ips/3667478b-be00-4ef6-89b1-1dd96f80ea9d => generated 0 bytes in 5378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:18.767590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-981e1aa5-e33d-413c-927a-cfacf0837240 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] Calling method '.version_select at 0x7eff5c5168b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:18.800371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:18.956590 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-981e1aa5-e33d-413c-927a-cfacf0837240 tempest-ServersTestFqdnHostnames-512753941 tempest-ServersTestFqdnHostnames-512753941-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664415755" status: 202 len: 0 microversion: 2.1 time: 0.205653 Nov 02 12:42:18.964210 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 695/1384] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1664415755 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:18.986739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5694b1a0-d1a5-4c68-b232-e6eb59864371 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c5593a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.328723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:19.369187 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2bd63e49-ad07-4eb6-911d-4eebb9399a92 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 1.100446 Nov 02 12:42:19.381044 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 690/1385] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:18 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:19.413675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9a3dcee3-886a-4b46-a22f-0a34ed11367c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c274b80>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.566959 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9a3dcee3-886a-4b46-a22f-0a34ed11367c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.180170 Nov 02 12:42:19.571987 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 691/1386] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:19 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:19.943729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3918a345-1137-499b-a19a-da0d58f91a74", "name": "network-vif-plugged", "status": "completed", "tag": "be6cb95f-365e-4c40-be18-d4841fe5acf9"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:19.972469 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.974524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.987801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.034356 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] Creating event network-vif-plugged:be6cb95f-365e-4c40-be18-d4841fe5acf9 for instance 3918a345-1137-499b-a19a-da0d58f91a74 on n-h1-857339-6 Nov 02 12:42:20.047764 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-4f9abe1a-a836-4ba5-a0ec-b305c525ce56 req-60440f1e-9281-449b-b63a-15e808036e2f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108988 Nov 02 12:42:20.052190 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 692/1387] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:20.407709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:20.409321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:20.436696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.439061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.443083 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.451277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.452351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.461547 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.641256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:22.549742 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:22.606808 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb88934c-8732-4fb2-8755-36b8ccd79565 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 2.197511 Nov 02 12:42:22.606808 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 693/1388] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:20 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:22.635359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b99ab0f0-7959-454c-9b57-8db8c89ac413 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27aa60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:22.865487 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b99ab0f0-7959-454c-9b57-8db8c89ac413 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.254565 Nov 02 12:42:22.882734 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 694/1389] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:22 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:23.526681 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e2221512-df06-4a1d-88fb-2a166cfff7dc tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c2149d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1366059539", "description": "tempest-description-154890474"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:24.011447 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5694b1a0-d1a5-4c68-b232-e6eb59864371 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/0c889547-e027-4e0f-9825-6fb9a8734e27" status: 202 len: 0 microversion: 2.1 time: 5.044059 Nov 02 12:42:24.017075 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 696/1390] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:18 2022] DELETE /compute/v2.1/os-floating-ips/0c889547-e027-4e0f-9825-6fb9a8734e27 => generated 0 bytes in 5052 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:24.033082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:24.042231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:24.112580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.119859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.120854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.130996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.130996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.130996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.779178 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e2221512-df06-4a1d-88fb-2a166cfff7dc tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.893896 Nov 02 12:42:24.780921 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 695/1391] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:22 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:24.787418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a20af1-ba94-4459-8b9b-5f170a876caa", "name": "network-vif-plugged", "status": "completed", "tag": "d727cd98-7b6e-45c4-ba61-de6bced45d8d"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:24.817327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.819849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.826617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.851227 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] Creating event network-vif-plugged:d727cd98-7b6e-45c4-ba61-de6bced45d8d for instance c1a20af1-ba94-4459-8b9b-5f170a876caa on n-h1-857339-6 Nov 02 12:42:24.868838 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-743d88cd-3d05-4896-94c8-124049ef41d1 req-198b1408-5d89-4fe5-812a-9f70a715da5f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086349 Nov 02 12:42:24.872247 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 696/1392] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:24.896606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-763ed7cd-8e71-4873-8370-ff9281a8dd5a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2aa9d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:24.918125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:24.943358 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c33549f4-d735-40ef-93ff-3d0ad584cf05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.923761 Nov 02 12:42:24.943905 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 697/1393] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:24 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:24.997057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-45087410-4ef8-40d1-b1d1-c7b7abfd2271 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] Calling method '.version_select at 0x7eff5c209040>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:25.067269 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-763ed7cd-8e71-4873-8370-ff9281a8dd5a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.192754 Nov 02 12:42:25.073249 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 697/1394] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:24 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:25.095478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1372a14a-3090-4275-adfc-95b8c2315f4a tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c2141f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1600951253", "description": "tempest-description-1182451860"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:26.824166 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1372a14a-3090-4275-adfc-95b8c2315f4a tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.749190 Nov 02 12:42:26.825118 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 698/1395] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:25 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:27.018878 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-615db27d-7234-418f-9e1f-61280aaa863d tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Action: 'create', calling method: .version_select at 0x7eff5c38aaf0>, body: {"keypair": {"name": "tempest-keypair-176812100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHd02PV9pVbtnDgHWuboYa8FRIKfw9l3pJfbHsvsDWBKZpKB5hvrjd9ocgSijlDuGp7rDIr+WybmJxQMw8rMc1VZMEH9EW14b3A3vc1JqD98qhBfdbA7remz4Pwy8iswDg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:27.048580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-615db27d-7234-418f-9e1f-61280aaa863d tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Getting quotas for project e1824edba1954bc49c70a63cedd89d53. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:27.061550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-615db27d-7234-418f-9e1f-61280aaa863d tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Getting quotas for user ac27c842f7b64080b644fff53f294c65 and project e1824edba1954bc49c70a63cedd89d53. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:27.196845 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-615db27d-7234-418f-9e1f-61280aaa863d tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.368892 Nov 02 12:42:27.196845 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 699/1396] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:42:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:27.207178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:27.210223 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:27.235299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.238107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.240224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.242285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.245622 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.247908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.938675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:27.947098 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4546cf8a-c193-4162-86dc-6073ef862369 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1316 microversion: 2.1 time: 0.748562 Nov 02 12:42:27.947702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 700/1397] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:27 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:27.958332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d006259a-6d7a-4b81-b6b9-c1e94b46d9d6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c214a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:28.063780 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d006259a-6d7a-4b81-b6b9-c1e94b46d9d6 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.114209 Nov 02 12:42:28.066393 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 701/1398] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:27 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:28.084050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-251018418", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "37a1ceb0-2561-4dbf-8104-e8d9569dabdc"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:28.241506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] validate_networks() for [('37a1ceb0-2561-4dbf-8104-e8d9569dabdc', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:29.873100 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9) Nov 02 12:42:29.879062 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.883110 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:29.883110 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 207 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-251018418", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "37a1ceb0-2561-4dbf-8104-e8d9569dabdc"}]}} Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-251018418', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '37a1ceb0-2561-4dbf-8104-e8d9569dabdc'}]}}} Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:29.888384 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-54f2e6a2-dc80-44e6-81f0-99e708e37cb9) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:42:29.893816 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.901835 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:29.907901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:29.907901 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:29.907901 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f8ff91e0-2c7a-4971-8905-3679318237d3 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.829001 Nov 02 12:42:29.907901 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 702/1399] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 1831 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:42:29.921743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:29.928946 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:29.945941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.953279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.954047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.955589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.956340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.957047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.394199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:31.410689 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-46ed3563-6225-4dcc-9110-854612f85135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1466 microversion: 2.1 time: 1.497477 Nov 02 12:42:31.414246 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-45087410-4ef8-40d1-b1d1-c7b7abfd2271 tempest-FloatingIPDetailsTestJSON-899214253 tempest-FloatingIPDetailsTestJSON-899214253-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/0f93d293-b65d-4828-9c3f-1797a919659d" status: 202 len: 0 microversion: 2.1 time: 6.445268 Nov 02 12:42:31.420795 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 698/1400] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:42:24 2022] DELETE /compute/v2.1/os-floating-ips/0f93d293-b65d-4828-9c3f-1797a919659d => generated 0 bytes in 6453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:31.435256 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 703/1401] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:29 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1466 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:31.444212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8e3c142e-170c-4638-88e1-d27fe53814ad tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:31.648181 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8e3c142e-170c-4638-88e1-d27fe53814ad tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.225521 Nov 02 12:42:31.665745 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 699/1402] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:31 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:31.701317 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7a368ea1-24dc-4a2d-b90e-c3e2652e7893 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c4b69d0>, body: {"security_group": {"name": " tempest-securitygroup -1283861410 ", "description": "tempest-description-2028324333"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:32.193945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2022322941", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "8a460de8-3ae8-4a67-86bd-a09edd274420"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:32.414599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] validate_networks() for [('8a460de8-3ae8-4a67-86bd-a09edd274420', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de27f842-8565-4cb6-96ee-47793f39762d) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:34.103228 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de27f842-8565-4cb6-96ee-47793f39762d) Nov 02 12:42:34.108404 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.110498 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:34.111766 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:34.111766 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] Request method failure captured: Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 208 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmW1CarDUo6JsovR7To9A1znj7MFfQQPCeM9vyKXzqxkLnnrTdppMiIDCxXtuoYr7mjq5tEpbiLLCJsyB4E1vC03yRrJQ8_GbsvOFxK-J5rFxcgo36RLqRCthIkBBeoCif2V0VAZChmOByFFEg5UBQ50jJPY6FOfHzzBbcYpHq55HL4 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8e13ff7300624e8fa370352995786a37 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerPasswordTestJSON-2107984552 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8e13ff7300624e8fa370352995786a37", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8e13ff7300624e8fa370352995786a37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8e13ff7300624e8fa370352995786a37"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8e13ff7300624e8fa370352995786a37"}]}] Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerPasswordTestJSON-2107984552 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8e13ff7300624e8fa370352995786a37 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2107984552 Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerPasswordTestJSON-2107984552-project Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: bdf89c77e6324917bcce6b192344ff8b Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerPasswordTestJSON-2107984552-project Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerPasswordTestJSON-server-2022322941", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "8a460de8-3ae8-4a67-86bd-a09edd274420"}]}} Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerPasswordTestJSON-server-2022322941', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '8a460de8-3ae8-4a67-86bd-a09edd274420'}]}}} Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:34.114475 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-de27f842-8565-4cb6-96ee-47793f39762d) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:42:34.120346 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.128725 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:34.131372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:34.131372 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:34.134047 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0ababc14-f7c2-4be3-8e28-0cdb458be092 tempest-ServerPasswordTestJSON-2107984552 tempest-ServerPasswordTestJSON-2107984552-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.696733 Nov 02 12:42:34.136901 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 704/1403] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 2701 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:42:34.146907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:34.148088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:34.157616 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.158496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.159147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.160702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:34.161393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:34.162019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:34.923597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=6 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:34.990113 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7a368ea1-24dc-4a2d-b90e-c3e2652e7893 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 3.322003 Nov 02 12:42:35.000599 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 700/1404] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:31 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 3326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:35.000599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8323ecd9-6b9d-4bd7-b784-f13a8c6d9a04 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c389af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.108060 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-93e0c64c-8cf0-4918-a165-e1de6f621ce8 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1617 microversion: 2.1 time: 0.965547 Nov 02 12:42:35.111197 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 705/1405] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:34 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1617 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:35.132770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-016788a9-e18b-4f98-a827-482b7330091b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c1f0160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.164725 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8323ecd9-6b9d-4bd7-b784-f13a8c6d9a04 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.170603 Nov 02 12:42:35.165372 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 701/1406] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:34 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:35.397408 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-016788a9-e18b-4f98-a827-482b7330091b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675" status: 200 len: 224 microversion: 2.1 time: 0.284530 Nov 02 12:42:35.399944 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 706/1407] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:35 2022] GET /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 => generated 224 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:35.422509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f38084de-2ab5-4e9a-aeac-7ac26e07bf47 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c60f700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:35.604907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1923579237", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "48de1b1f-9d7e-41bf-b1e6-023d17cecc0e"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:35.810599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:36.747251 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f38084de-2ab5-4e9a-aeac-7ac26e07bf47 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675" status: 202 len: 0 microversion: 2.1 time: 1.332680 Nov 02 12:42:36.750012 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 702/1408] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:35 2022] DELETE /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 => generated 0 bytes in 1337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:36.776377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-83593f12-04ce-4477-8281-b8d335363d2c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c5594c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:36.868590 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-83593f12-04ce-4477-8281-b8d335363d2c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.116597 Nov 02 12:42:36.871157 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 703/1409] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:36.882929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c60f670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:37.052708 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:42:37.053641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:42:37.054390 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.054390 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 HTTP/1.1 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '649bbe0e-57b6-47ed-8268-6d02dbaf2675'} Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:42:37.057298 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] Nov 02 12:42:37.063406 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:37.069444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:42:37.069444 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6c2c0e09-450f-44f5-b86c-118844432315'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:37.071012 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aaf76b82-fc62-48a6-961c-cd0593f0bf8c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675" status: 404 len: 194 microversion: 2.1 time: 0.198563 Nov 02 12:42:37.077863 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 704/1410] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:36 2022] GET /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 => generated 194 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:37.084233 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20e9b6fa-ae03-455b-a84a-05df84945e98 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c5591f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-634706678", "description": "tempest-description-1607194437"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:37.099075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:37.206273 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:42:37.207076 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:42:37.216439 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:42:37.220888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:42:37.222133 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:42:37.270834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.272137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.273275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.274960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:37.276103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:37.277431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:37.324071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:37.343887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Getting quotas for user 7f1602f439f64597ae371c084e7faed0 and project cdd844366c7343be97d0911ff5c05ba4. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:37.413597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:42:37.426896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:42:37.884230 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d6b4cfff-9b9e-43de-b0c8-2fecc726d0c0 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.283221 Nov 02 12:42:37.943126 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 707/1411] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:42:37.943126 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fdbaf53b-856f-4e68-adb2-a2826bc1ccf2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c269040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.139732 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fdbaf53b-856f-4e68-adb2-a2826bc1ccf2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.237128 Nov 02 12:42:38.161513 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 708/1412] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:37 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:38.196093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f37d7413-46b9-4acb-b3ba-dcf0dfbe0e1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:38.209846 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f37d7413-46b9-4acb-b3ba-dcf0dfbe0e1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:38.746977 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20e9b6fa-ae03-455b-a84a-05df84945e98 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.666574 Nov 02 12:42:38.747877 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 705/1413] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:38.757132 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-f37d7413-46b9-4acb-b3ba-dcf0dfbe0e1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:38.769401 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-303fa3ab-04ff-4798-aad8-86a528ec2430 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c551550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1774315799", "description": "tempest-description-1899237983"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:38.789877 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f37d7413-46b9-4acb-b3ba-dcf0dfbe0e1d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1217 microversion: 2.1 time: 0.621017 Nov 02 12:42:38.792546 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 709/1414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:38 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1217 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.179785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fda7cca-41d0-4e40-bbdf-378788653b7f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f08b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.530727 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4fda7cca-41d0-4e40-bbdf-378788653b7f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.338307 Nov 02 12:42:39.537309 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 710/1415] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:39.819279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-708b8564-f944-47c7-ac32-027c37925696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:39.820429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-708b8564-f944-47c7-ac32-027c37925696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:40.343020 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-708b8564-f944-47c7-ac32-027c37925696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:40.380344 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-708b8564-f944-47c7-ac32-027c37925696 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1217 microversion: 2.1 time: 0.565315 Nov 02 12:42:40.384172 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 711/1416] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:39 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1217 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:40.566223 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e5c1c752-ebbb-439d-8f30-675d67efd928 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2aa820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:40.628926 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-303fa3ab-04ff-4798-aad8-86a528ec2430 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.865316 Nov 02 12:42:40.640708 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 706/1417] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:40.660690 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fe210210-b51c-4d95-b7c5-b223f41fb07c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c60f700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-271995988", "description": "tempest-description-108255345"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:40.785322 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e5c1c752-ebbb-439d-8f30-675d67efd928 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.219167 Nov 02 12:42:40.787669 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 712/1418] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:40 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.414271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:41.423621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:41.452391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.458637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.458637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.458637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:41.458637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:41.458637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:41.684744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:41.703297 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-96c70ea6-abe9-4f87-8151-97c2b0a9f683 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1269 microversion: 2.1 time: 0.297213 Nov 02 12:42:41.714560 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 713/1419] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:41 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1269 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:41.722129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942923198", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a3a27c0-5a2a-4533-be1c-39e6c96fff30"}], "security_groups": [{"name": "tempest-securitygroup--1925407433"}], "key_name": "tempest-keypair-176812100", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:42.158743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] validate_networks() for [('2a3a27c0-5a2a-4533-be1c-39e6c96fff30', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:42.195187 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fe210210-b51c-4d95-b7c5-b223f41fb07c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.544943 Nov 02 12:42:42.196836 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 707/1420] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:40 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:42:42.208766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-633125fc-3499-4c96-b9da-3fc4d29640e2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4c91f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.393043 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-633125fc-3499-4c96-b9da-3fc4d29640e2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.193958 Nov 02 12:42:42.404074 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 708/1421] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:42.424053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b2b52c50-2339-4f74-b27b-826517c2e808 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c4b6c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80ec8aa0-3c9a-4995-90ef-db050210a1de) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:42.755533 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80ec8aa0-3c9a-4995-90ef-db050210a1de) Nov 02 12:42:42.760362 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.763840 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:42.763840 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Request method failure captured: Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 485 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWxOG4183xPPM3mTag3I2ajclCE8ZJyk24z2D9q84pPi4YLajLyQt5q-hPFcMN7EPVaLj7qwyGu_I6g7Ffv4mM76lbGu5EMBTzTzTSEXeSRxP0dmfhblGqFUH8DdL6ommiuLjZYtS3-gZFd6z0QvlCXmKP_d0mRdS1tmkvkQP2ABJI Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e1824edba1954bc49c70a63cedd89d53 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e1824edba1954bc49c70a63cedd89d53", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e1824edba1954bc49c70a63cedd89d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e1824edba1954bc49c70a63cedd89d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e1824edba1954bc49c70a63cedd89d53"}]}] Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e1824edba1954bc49c70a63cedd89d53 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AttachVolumeTestJSON-1195637149-project Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ac27c842f7b64080b644fff53f294c65 Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AttachVolumeTestJSON-1195637149-project Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1942923198", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "2a3a27c0-5a2a-4533-be1c-39e6c96fff30"}], "security_groups": [{"name": "tempest-securitygroup--1925407433"}], "key_name": "tempest-keypair-176812100", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-1942923198', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '2a3a27c0-5a2a-4533-be1c-39e6c96fff30'}], 'security_groups': [{'name': 'tempest-securitygroup--1925407433'}], 'key_name': 'tempest-keypair-176812100', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:42.766631 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-80ec8aa0-3c9a-4995-90ef-db050210a1de) Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:42.777627 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-241993c1-d90b-4ee3-9073-1720e24d2bb7 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.051950 Nov 02 12:42:42.786702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 714/1422] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:41 2022] POST /compute/v2.1/servers => generated 214 bytes in 1054 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:42:42.792945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:42.797552 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:42.812856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.813433 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.814818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:42.817503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:42.818434 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:42.824140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:43.371052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:43.401416 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4161a6fa-0b95-4411-8ccd-698a4c75ed42 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1287 microversion: 2.1 time: 0.631113 Nov 02 12:42:43.403380 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 715/1423] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1287 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:43.420548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f062f612-149c-4780-87e0-90a67d11082a tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Calling method '.version_select at 0x7eff5c27a550>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.602245 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f062f612-149c-4780-87e0-90a67d11082a tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-176812100" status: 202 len: 0 microversion: 2.1 time: 0.179790 Nov 02 12:42:43.605556 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 716/1424] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:42:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-176812100 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:43.620981 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f90d815-3c8a-41d9-b5b3-d0e1e9e56c7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.727431 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b2b52c50-2339-4f74-b27b-826517c2e808 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 1.319081 Nov 02 12:42:43.729008 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 709/1425] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:42:42 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:43.760374 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-144148bd-dce0-4e9d-84ea-b75f34cb9f4b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c551820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:43.794721 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4f90d815-3c8a-41d9-b5b3-d0e1e9e56c7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.185213 Nov 02 12:42:43.800238 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 717/1426] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:43 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:44.431690 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.432658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:44.446193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.448330 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.453378 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.460896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:44.460896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:44.460896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:44.817993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:44.836211 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4ca911ae-e460-4b50-aba9-06ecb4ba47c3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1275 microversion: 2.1 time: 0.406627 Nov 02 12:42:44.840167 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 718/1427] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:44 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1275 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:44.856646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-32a3753e-12ed-44fd-b388-a1d140e19387 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2149d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:44.995085 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-32a3753e-12ed-44fd-b388-a1d140e19387 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.153053 Nov 02 12:42:44.998079 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 719/1428] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:44 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:45.867331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:45.868042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:45.897027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.898050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.898819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.908988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:45.911050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:45.920758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:45.935317 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=60 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:46.104723 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-144148bd-dce0-4e9d-84ea-b75f34cb9f4b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914" status: 202 len: 0 microversion: 2.1 time: 2.349655 Nov 02 12:42:46.108913 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 710/1429] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:43 2022] DELETE /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914 => generated 0 bytes in 2351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:42:46.111391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-73f9d701-25d3-402d-922a-7518a5ad115b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1dfb80>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:46.213979 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-73f9d701-25d3-402d-922a-7518a5ad115b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.106205 Nov 02 12:42:46.213979 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 711/1430] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:46 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:46.234120 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c261e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:46.635264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:46.644635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:42:46.645234 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:42:46.646787 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.646787 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914 HTTP/1.1 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '7111b071-ab1e-4481-bfd6-0dab77f0b914'} Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:42:46.650594 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-488385db-95d7-49c3-8f63-95dd0676c0a8'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:46.656575 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-31085d44-de5e-428f-bc36-065d2f33acf6 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914" status: 404 len: 194 microversion: 2.1 time: 0.435076 Nov 02 12:42:46.663731 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 712/1431] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:46 2022] GET /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914 => generated 194 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:46.691317 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c2e6a825-5ba1-487a-9175-5714ab2ff981 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.824970 Nov 02 12:42:46.692190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b154c61d-3f17-4067-8052-dd564a524f5b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c8baee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:46.695166 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 720/1432] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:45 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.230208 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-48009a45-3f08-4b88-b941-02621eb1a310 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2aa820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:47.305783 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:47.370179 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-48009a45-3f08-4b88-b941-02621eb1a310 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.144005 Nov 02 12:42:47.387652 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 721/1433] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:47 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:47.719675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:47.720655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:47.749463 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.755226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.755226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:47.755226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:47.757619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:47.758794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:48.356512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:48.376262 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ea3888aa-74e6-4587-9d84-1dd0b93d5265 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.661497 Nov 02 12:42:48.390452 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 722/1434] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:47 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:48.408034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-56e5acc7-0e88-493c-acb3-7c168655c6d3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2145e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:48.436235 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b154c61d-3f17-4067-8052-dd564a524f5b tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946" status: 202 len: 0 microversion: 2.1 time: 1.770386 Nov 02 12:42:48.440019 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 713/1435] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:46 2022] DELETE /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946 => generated 0 bytes in 1776 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:48.445604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c261a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:48.531615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:42:48.532214 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 829ec954-2307-462a-a5be-634fc7711946 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:42:48.532767 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.532767 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946 HTTP/1.1 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '829ec954-2307-462a-a5be-634fc7711946'} Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:42:48.534623 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] Nov 02 12:42:48.538998 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:48.544764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:42:48.544764 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-624e4f25-3fb3-4ba6-8bd3-97de8ac05d31'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:48.545669 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eccb015c-bba1-4451-aea3-19760677a4a4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946" status: 404 len: 194 microversion: 2.1 time: 0.104593 Nov 02 12:42:48.546395 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 714/1436] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:48 2022] GET /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946 => generated 194 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:48.558401 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-56e5acc7-0e88-493c-acb3-7c168655c6d3 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.150842 Nov 02 12:42:48.558401 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 723/1437] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:48 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:48.567711 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08ea0019-9a4b-4e12-b977-a808217bd378 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c5169d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.379637 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-08ea0019-9a4b-4e12-b977-a808217bd378 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240" status: 202 len: 0 microversion: 2.1 time: 0.828957 Nov 02 12:42:49.380242 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 715/1438] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:48 2022] DELETE /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240 => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:49.389744 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c2aa0d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.419515 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.420580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:49.427413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.432837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.437118 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.439124 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:49.441282 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:49.442012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:49.675464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0d83151-d425-441e-badf-5179390cc240 does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:42:49.676554 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group e0d83151-d425-441e-badf-5179390cc240 not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:42:49.677269 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.677269 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240 HTTP/1.1 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e0d83151-d425-441e-badf-5179390cc240'} Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:42:49.679501 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] Nov 02 12:42:49.685214 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:42:49.691045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:42:49.691045 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-9649f8a8-c794-4d58-aca4-35b6b8cfe3c9'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:49.691045 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-10e081b4-0728-430f-a988-989eda35abad tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240" status: 404 len: 194 microversion: 2.1 time: 0.305302 Nov 02 12:42:49.700692 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 724/1439] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240 => generated 194 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:42:49.700692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cce14684-d420-4fec-a46c-2812ffe67b2a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1c0790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.790419 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cce14684-d420-4fec-a46c-2812ffe67b2a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.097646 Nov 02 12:42:49.791739 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 725/1440] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:49.821630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ce1cc8c6-55e9-4a02-bdd3-39560e1630e5 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Action: 'create', calling method: .version_select at 0x7eff5c2145e0>, body: {"keypair": {"name": "tempest-keypair-663491774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5iVdZlVkBbqVYbEb3ClJG3vOYWbkzz1cwfQ5Fti0+tUkURr1kGewGZvYSg0eJxJv8ADzRbfy6mqLtx//dhECPW7vGHbkjrD4IRWG0DJJCT8RArZsrNsptIY9x/o4ApMQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:49.835381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:49.851280 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:49.868176 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-17b9b078-9401-4e85-b0f8-232caa0f4228 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.452312 Nov 02 12:42:49.869693 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 716/1441] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:49.878182 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-85057cb4-48d4-4afc-8052-95285efb95e7 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c559b80>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:49.885418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ce1cc8c6-55e9-4a02-bdd3-39560e1630e5 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Getting quotas for project e1824edba1954bc49c70a63cedd89d53. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:42:49.893805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ce1cc8c6-55e9-4a02-bdd3-39560e1630e5 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Getting quotas for user ac27c842f7b64080b644fff53f294c65 and project e1824edba1954bc49c70a63cedd89d53. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:42:50.053224 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ce1cc8c6-55e9-4a02-bdd3-39560e1630e5 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.239225 Nov 02 12:42:50.054674 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 726/1442] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:42:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:50.812873 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c3beb3b8-56fd-4937-ad0a-75a52b9e3c66 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27a040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:51.028686 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-85057cb4-48d4-4afc-8052-95285efb95e7 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.154228 Nov 02 12:42:51.031418 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 717/1443] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:42:49 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:51.084115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:51.089022 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:51.110902 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c3beb3b8-56fd-4937-ad0a-75a52b9e3c66 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.292750 Nov 02 12:42:51.114058 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 727/1444] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:50 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:51.134472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-403e6a3f-015f-4f7a-97cf-ff803ffa793f tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c1c0ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1295175984", "description": "tempest-description-1516655571"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:51.189043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.189600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.197954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.197954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:51.197954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:51.197954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:51.577856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:51.592987 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1879d6a5-ed48-4bec-8565-ef4258e19678 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.559605 Nov 02 12:42:51.593951 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 718/1445] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:51 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:52.066704 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-403e6a3f-015f-4f7a-97cf-ff803ffa793f tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.936453 Nov 02 12:42:52.067333 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 728/1446] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:51 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:52.080709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-02a7ba7d-2e3b-42d9-89c9-0f10f992dce2 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c261040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-367554867", "description": "tempest-description-46324255"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:52.141602 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c515066a-0be2-4bcc-8bcd-21629db76185 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c38ae50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:52.266147 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c515066a-0be2-4bcc-8bcd-21629db76185 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.128290 Nov 02 12:42:52.280316 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 729/1447] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:52.623360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:52.624388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:52.646513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.647041 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.647490 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.648251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:52.648765 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:52.649177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:52.946122 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:52.957448 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-035ecddd-6361-4ab0-b4a7-52dfae8a67fb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.337959 Nov 02 12:42:52.958711 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 730/1448] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:52 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:52.982081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17776d8a-ef14-463d-90d5-d1b086edd054", "tag": "aba353f5-51f0-41f5-af78-c78549736744"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:53.000213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:53.000420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:53.002336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:53.051273 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] Creating event network-changed:aba353f5-51f0-41f5-af78-c78549736744 for instance 17776d8a-ef14-463d-90d5-d1b086edd054 on n-h2-857339-6 Nov 02 12:42:53.079275 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-98df584a-65fb-4d8b-9303-d7ba098bfd28 req-ba7332c9-00f3-4648-8be8-29ebe628d4d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103359 Nov 02 12:42:53.093159 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 731/1449] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:53.259351 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-02a7ba7d-2e3b-42d9-89c9-0f10f992dce2 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 1.182130 Nov 02 12:42:53.260407 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 719/1450] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:52 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:53.298649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-78953a06-2218-4fc8-8c81-e0d78debc54f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.418356 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-78953a06-2218-4fc8-8c81-e0d78debc54f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.125756 Nov 02 12:42:53.419368 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 732/1451] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:53 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:53.508634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-372280083", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "37a1ceb0-2561-4dbf-8104-e8d9569dabdc"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:53.707366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] validate_networks() for [('37a1ceb0-2561-4dbf-8104-e8d9569dabdc', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:53.983627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:53.984990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:54.002997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.003905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.005332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.006298 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:54.008329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:54.012473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01998a5f-9326-4ebf-bc95-3518705c8390) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:54.499874 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01998a5f-9326-4ebf-bc95-3518705c8390) Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 207 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-372280083", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "37a1ceb0-2561-4dbf-8104-e8d9569dabdc"}]}} Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-SecurityGroupsTestJSON-server-372280083', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '37a1ceb0-2561-4dbf-8104-e8d9569dabdc'}]}}} Nov 02 12:42:54.512041 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:42:54.522395 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-01998a5f-9326-4ebf-bc95-3518705c8390) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-edc558fb-6f11-41fb-bbd1-84b9380df343 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.000518 Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 720/1452] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 1002 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:42:54.528615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b114fd1-0ef4-4033-a90f-eda23ce6d1a0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1df820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:54.713379 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4b114fd1-0ef4-4033-a90f-eda23ce6d1a0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1455 microversion: 2.1 time: 0.177385 Nov 02 12:42:54.713379 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 721/1453] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:54 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:54.713379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60d9fa00-c5d0-4804-bf51-65b0f7ed4910 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'create', calling method: .version_select at 0x7eff5c516670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-245153242", "description": "tempest-description-1562323572"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:55.289561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:55.315272 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c70877d2-6768-4015-9ef4-1dea61da0018 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 1.335856 Nov 02 12:42:55.320700 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 733/1454] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:53 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:55.701593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5d02968c-7c1f-4e46-bec8-06140c08e6db tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0ee0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.792439 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5d02968c-7c1f-4e46-bec8-06140c08e6db tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1464 microversion: 2.1 time: 0.095231 Nov 02 12:42:55.793202 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 734/1455] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1464 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:55.808078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a1dae6ae-259e-4d67-b007-d0988a0f6109 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c335430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.875102 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a1dae6ae-259e-4d67-b007-d0988a0f6109 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 200 len: 1464 microversion: 2.1 time: 0.071180 Nov 02 12:42:55.877842 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 735/1456] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 1464 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:55.893973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:55.894702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:55.901825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.903286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.903986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.911086 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:55.912166 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:55.912837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:55.998208 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-60d9fa00-c5d0-4804-bf51-65b0f7ed4910 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.306475 Nov 02 12:42:56.000440 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 722/1457] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:42:54 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:56.013294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a25c87fb-b188-43fc-90db-84ed6190007c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Action: 'update', calling method: .version_select at 0x7eff5c261790>, body: {"security_group": {"name": "tempest-sg-hth-1231684780", "description": "tempest-description-hth-1252815669"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:56.499561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:56.510761 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1246a658-f9b9-476b-8cca-8b8fc6c5c093 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1468 microversion: 2.1 time: 0.620981 Nov 02 12:42:56.511660 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 736/1458] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:55 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1468 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:56.548743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:56.549381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:56.566934 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.567440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.567871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.570576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.572745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.574740 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.881843 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a25c87fb-b188-43fc-90db-84ed6190007c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "PUT /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a" status: 200 len: 218 microversion: 2.1 time: 0.873006 Nov 02 12:42:56.885797 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 723/1459] 10.222.0.64 () {60 vars in 1290 bytes} [Wed Nov 2 12:42:56 2022] PUT /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a => generated 218 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:56.901722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1939597987"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:56.905746 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:56.917449 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.918556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.921056 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:56.922108 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:56.923059 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:56.923824 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.426696 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:57.440218 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5cd72682-5e89-425b-8314-41ef5f8e0458 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.922737 Nov 02 12:42:57.441136 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 737/1460] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:56 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:57.465147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d993f0c9-7900-4f27-b6dc-8518328d8010 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c27a940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.618223 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-350c8326-e722-437e-aa88-ce7431ad1877 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "POST /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435/action" status: 202 len: 0 microversion: 2.1 time: 0.729324 Nov 02 12:42:57.626497 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 724/1461] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:56 2022] POST /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435/action => generated 0 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 02 12:42:57.633194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7153409e-3f66-49a9-b19e-16007620097d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1df430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.649419 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d993f0c9-7900-4f27-b6dc-8518328d8010 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "GET /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a" status: 200 len: 218 microversion: 2.1 time: 0.196942 Nov 02 12:42:57.660810 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 738/1462] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a => generated 218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:57.666505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d2036518-146d-4ff6-b682-c43ddf3cb0ba tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c214700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.710423 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7153409e-3f66-49a9-b19e-16007620097d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.080082 Nov 02 12:42:57.710423 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 725/1463] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:57.924731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Calling method '.version_select at 0x7eff5c476160>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:57.939073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.939529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.939931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.940698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:57.941154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:57.941575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:57.973773 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b1079802-719b-4852-a868-9ee9a44a94cd tempest-AbsoluteLimitsTestJSON-558826326 tempest-AbsoluteLimitsTestJSON-558826326-project] 10.222.0.64 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.195207 Nov 02 12:42:57.974554 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 726/1464] 10.222.0.64 () {58 vars in 1122 bytes} [Wed Nov 2 12:42:57 2022] GET /compute/v2.1/limits => generated 511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:58.369967 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d2036518-146d-4ff6-b682-c43ddf3cb0ba tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a" status: 202 len: 0 microversion: 2.1 time: 0.708924 Nov 02 12:42:58.382625 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 739/1465] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:57 2022] DELETE /compute/v2.1/os-security-groups/bf8a81bd-6c9a-4bb1-a5de-f7bfaa457f8a => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:58.383364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-55af5e65-b1fd-495f-b080-4a62b105ae5c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c4899d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.473243 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:58.475098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:58.514386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.517672 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.521805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:58.527869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:58.528927 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:58.533855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.046725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:59.056239 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2bdd00f1-1c1c-41a5-809b-0e64a7304010 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.592831 Nov 02 12:42:59.073541 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 740/1466] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:58 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:59.073541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3918a345-1137-499b-a19a-da0d58f91a74", "name": "network-vif-unplugged", "status": "completed", "tag": "be6cb95f-365e-4c40-be18-d4841fe5acf9"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:59.079806 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:59.080279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:59.080956 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:59.093497 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] Creating event network-vif-unplugged:be6cb95f-365e-4c40-be18-d4841fe5acf9 for instance 3918a345-1137-499b-a19a-da0d58f91a74 on n-h1-857339-6 Nov 02 12:42:59.099646 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-a2c88475-76a4-4dac-aadb-d51db45e30b7 req-c77f387e-6004-43fa-a484-1cd90bfd562b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033034 Nov 02 12:42:59.099781 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 741/1467] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:59.104970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5c0002a5-0768-4e87-b45b-881fc19b0445 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1c0af0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.163526 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5c0002a5-0768-4e87-b45b-881fc19b0445 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.062526 Nov 02 12:42:59.168701 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 742/1468] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:42:59 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:59.180068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1205725641", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2a3a27c0-5a2a-4533-be1c-39e6c96fff30"}], "security_groups": [{"name": "tempest-securitygroup--1184881852"}], "key_name": "tempest-keypair-663491774", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:59.700684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] validate_networks() for [('2a3a27c0-5a2a-4533-be1c-39e6c96fff30', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:42:59.782641 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-55af5e65-b1fd-495f-b080-4a62b105ae5c tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/2c947c60-c85f-4d4a-a967-82aa6c03d32c" status: 202 len: 0 microversion: 2.1 time: 1.405707 Nov 02 12:42:59.783990 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 727/1469] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:58 2022] DELETE /compute/v2.1/os-security-groups/2c947c60-c85f-4d4a-a967-82aa6c03d32c => generated 0 bytes in 1408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:59.792561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60f73e56-7280-4870-b991-c6f37a4a792d tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c476ee0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:59.912899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=14 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd7af294-4f74-4858-a4a5-0c724aa1f22a) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:00.493146 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd7af294-4f74-4858-a4a5-0c724aa1f22a) Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Request method failure captured: Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 485 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWxOG4183xPPM3mTag3I2ajclCE8ZJyk24z2D9q84pPi4YLajLyQt5q-hPFcMN7EPVaLj7qwyGu_I6g7Ffv4mM76lbGu5EMBTzTzTSEXeSRxP0dmfhblGqFUH8DdL6ommiuLjZYtS3-gZFd6z0QvlCXmKP_d0mRdS1tmkvkQP2ABJI Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e1824edba1954bc49c70a63cedd89d53 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e1824edba1954bc49c70a63cedd89d53", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e1824edba1954bc49c70a63cedd89d53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e1824edba1954bc49c70a63cedd89d53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e1824edba1954bc49c70a63cedd89d53"}]}] Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e1824edba1954bc49c70a63cedd89d53 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1195637149 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AttachVolumeTestJSON-1195637149-project Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ac27c842f7b64080b644fff53f294c65 Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AttachVolumeTestJSON-1195637149-project Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1205725641", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "2a3a27c0-5a2a-4533-be1c-39e6c96fff30"}], "security_groups": [{"name": "tempest-securitygroup--1184881852"}], "key_name": "tempest-keypair-663491774", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:00.502543 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeTestJSON-server-1205725641', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '2a3a27c0-5a2a-4533-be1c-39e6c96fff30'}], 'security_groups': [{'name': 'tempest-securitygroup--1184881852'}], 'key_name': 'tempest-keypair-663491774', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:00.507457 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bd7af294-4f74-4858-a4a5-0c724aa1f22a) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f4989be4-8c07-4841-b473-42b46cb11964 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.334340 Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 743/1470] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:42:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1336 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:43:00.526810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:00.531589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:00.539119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.539843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.540516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.541852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:00.542882 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:00.543515 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:00.941143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:00.950919 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7645fff4-136d-4461-9f40-33ca3abe4135 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 0.444874 Nov 02 12:43:00.967455 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 744/1471] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:00.974804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-470efda4-a4c4-439d-bb68-6f5c50c2f38b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c3358b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.041778 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-60f73e56-7280-4870-b991-c6f37a4a792d tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/7cf6e0a0-097e-4b58-afc6-7a4d00285eb5" status: 202 len: 0 microversion: 2.1 time: 1.249611 Nov 02 12:43:01.041778 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 728/1472] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:42:59 2022] DELETE /compute/v2.1/os-security-groups/7cf6e0a0-097e-4b58-afc6-7a4d00285eb5 => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:43:01.043875 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-470efda4-a4c4-439d-bb68-6f5c50c2f38b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.075103 Nov 02 12:43:01.044662 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 745/1473] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:00 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:01.050437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c255aafc-4166-4216-b31b-d0cb0cc735f1 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] Calling method '.version_select at 0x7eff5c4b6dc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.057597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c1c0a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.128642 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0d83151-d425-441e-badf-5179390cc240 does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:01.129545 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group e0d83151-d425-441e-badf-5179390cc240 not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:43:01.130295 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.130295 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240 HTTP/1.1 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e0d83151-d425-441e-badf-5179390cc240'} Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:01.133121 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] Nov 02 12:43:01.138865 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.143747 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group e0d83151-d425-441e-badf-5179390cc240 does not exist Nov 02 12:43:01.143747 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-bd73084d-f2d2-42de-bd10-2df7fbd54c44'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:01.145203 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-981b17b3-bbf0-4dd9-99d2-8c30b5d2ae4e tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240" status: 404 len: 194 microversion: 2.1 time: 0.099598 Nov 02 12:43:01.146447 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 746/1474] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/e0d83151-d425-441e-badf-5179390cc240 => generated 194 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:01.157045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c1f0c10>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.198006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:01.199715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 829ec954-2307-462a-a5be-634fc7711946 not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:43:01.200537 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.200537 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946 HTTP/1.1 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '829ec954-2307-462a-a5be-634fc7711946'} Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:01.203297 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 829ec954-2307-462a-a5be-634fc7711946 does not exist Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-f5efc1d9-3fe6-4b13-8a93-4a97dd0f2829'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-409b3837-71de-46ff-ae60-ecc6baa11a26 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946" status: 404 len: 194 microversion: 2.1 time: 0.054766 Nov 02 12:43:01.210957 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 747/1475] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/829ec954-2307-462a-a5be-634fc7711946 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:43:01.221035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c2141f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.240329 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c255aafc-4166-4216-b31b-d0cb0cc735f1 tempest-AttachVolumeTestJSON-1195637149 tempest-AttachVolumeTestJSON-1195637149-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663491774" status: 202 len: 0 microversion: 2.1 time: 0.199192 Nov 02 12:43:01.241587 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 729/1476] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663491774 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:01.248206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:01.249183 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.security_group_api [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 not found {{(pid=127766) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:43:01.250076 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.250076 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914 HTTP/1.1 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '7111b071-ab1e-4481-bfd6-0dab77f0b914'} Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:01.253140 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] Nov 02 12:43:01.258668 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.264560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 7111b071-ab1e-4481-bfd6-0dab77f0b914 does not exist Nov 02 12:43:01.264560 n-d-857339-6 devstack@n-api.service[127766]: Neutron server returns request_ids: ['req-6250634c-5292-497d-8078-037dfdaa41a5'] {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:01.265247 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8fd12ba5-73d0-48e8-9572-2419c96e7768 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914" status: 404 len: 194 microversion: 2.1 time: 0.054505 Nov 02 12:43:01.266034 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 748/1477] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/7111b071-ab1e-4481-bfd6-0dab77f0b914 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:43:01.285790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c559dc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.346405 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:01.347666 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Neutron security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:43:01.348225 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] HTTP exception thrown: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.348225 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Request method failure captured: Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 HTTP/1.1 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmWs4k5izMeQdQt6S8-k_ajNnWmPrL1r2e2ix6jkHc9RbX6QQzcH84jX1Pz0MciDg1MQ6Ummc2yja1iGuy9ra3q61DQUSg810kww2OWM8A7gjK0MPdiD5WayFxCHB8jY6tKCP_ULzHSJD8UZjpg1ltgcW7KYKlWZSgXhUhUYwzccugc Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f48fdbeb9a604c66b66780387e3af4de", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f48fdbeb9a604c66b66780387e3af4de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f48fdbeb9a604c66b66780387e3af4de"}]}] Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: f48fdbeb9a604c66b66780387e3af4de Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1544760784 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d475a7c95ae7405db2483fc26ea0a8c5 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupsTestJSON-1544760784-project Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '649bbe0e-57b6-47ed-8268-6d02dbaf2675'} Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:01.350416 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Returning 404 to user: Security group 649bbe0e-57b6-47ed-8268-6d02dbaf2675 does not exist Nov 02 12:43:01.357892 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-1fa32efe-2718-4973-aa59-4bc250c77d8b'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:01.365832 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-24bb0cdc-c354-4b9b-9038-06e1817ce1b4 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675" status: 404 len: 194 microversion: 2.1 time: 0.082742 Nov 02 12:43:01.365832 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 730/1478] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/649bbe0e-57b6-47ed-8268-6d02dbaf2675 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:01.371919 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd07e104-d3e2-4cd6-bec4-99c4e20fe904 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c1c0dc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.936064 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dd07e104-d3e2-4cd6-bec4-99c4e20fe904 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/16b5c75f-ef7c-482f-875d-b153fa4bc372" status: 202 len: 0 microversion: 2.1 time: 0.571053 Nov 02 12:43:01.936974 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 749/1479] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/16b5c75f-ef7c-482f-875d-b153fa4bc372 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:01.939806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17776d8a-ef14-463d-90d5-d1b086edd054", "name": "network-vif-plugged", "status": "completed", "tag": "aba353f5-51f0-41f5-af78-c78549736744"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:01.945701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f739c3ae-ddb6-451b-b785-7b045e32bb82 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] Calling method '.version_select at 0x7eff5c2145e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:01.979696 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:01.986894 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:01.990092 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:02.085802 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] Creating event network-vif-plugged:aba353f5-51f0-41f5-af78-c78549736744 for instance 17776d8a-ef14-463d-90d5-d1b086edd054 on n-h2-857339-6 Nov 02 12:43:02.131629 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-f37b7053-971b-45af-a4f8-54b7c8ee2804 req-2d457ccb-10ae-4625-a4aa-65e915eb60fc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206310 Nov 02 12:43:02.132307 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 731/1480] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:02.147905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:02.149272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:02.163251 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:02.164066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:02.164729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:02.166890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:02.167545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:02.170788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:03.299206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:03.313534 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-88c5973c-b4e8-4b3e-8d80-f52dafce41b2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1317 microversion: 2.1 time: 1.177907 Nov 02 12:43:03.318192 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 732/1481] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:02 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1317 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:03.324723 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c4055e2-78c4-4388-b808-fff3c7164396 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559d30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:03.557890 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f739c3ae-ddb6-451b-b785-7b045e32bb82 tempest-SecurityGroupsTestJSON-1544760784 tempest-SecurityGroupsTestJSON-1544760784-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/53d24c00-2267-4f2b-a550-901ab787024a" status: 202 len: 0 microversion: 2.1 time: 1.616662 Nov 02 12:43:03.559542 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 750/1482] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:01 2022] DELETE /compute/v2.1/os-security-groups/53d24c00-2267-4f2b-a550-901ab787024a => generated 0 bytes in 1619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:04.300684 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-476178508", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:07.080194 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c4055e2-78c4-4388-b808-fff3c7164396 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 3.757696 Nov 02 12:43:07.089165 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 733/1483] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:03 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 3770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:07.124845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:07.125382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:07.126023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:07.127986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.130377 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:07.130901 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:07.132352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.165403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.168995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.169425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.170030 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.170766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.171627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.173062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.175351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.176085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.177079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.180752 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.181280 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.262904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Getting quotas for project 7a9a8c1c922b4a9eae99d190d10ba85e. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:07.289283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Getting quotas for user 346db825477f4cfca59dfa9ac8ab0455 and project 7a9a8c1c922b4a9eae99d190d10ba85e. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:07.333129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:43:07.336070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:43:07.613423 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bd811c01-67ce-436e-bbc7-3987556d6f15 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 4.052472 Nov 02 12:43:07.614150 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 751/1484] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4054 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:43:07.655302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.663791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.937691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:07.958318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:08.415142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:08.426533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:08.427999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:08.435930 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fdcd0767-6d96-4d4d-adfc-e8055e6ebb42 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1277 microversion: 2.57 time: 0.791994 Nov 02 12:43:08.440437 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 752/1485] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1277 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:08.460833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c71a8cdc-314b-4565-9591-32c7576023dd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c214a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:08.703208 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c71a8cdc-314b-4565-9591-32c7576023dd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.254941 Nov 02 12:43:08.712286 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 753/1486] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:08 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:08.732192 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-plugged", "status": "completed", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:08.763789 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.765031 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.776056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.800536 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] Creating event network-vif-plugged:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:43:08.809343 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-98387b83-ab8c-48e1-ab13-52063827abed req-c12f5f9f-a2ae-4fc2-8d9a-f78809f837b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094312 Nov 02 12:43:08.810694 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 754/1487] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:09.320786 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.331608 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b1bf58b1-85fb-4690-b8db-e584be9899db tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1467 microversion: 2.1 time: 2.239747 Nov 02 12:43:09.341822 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 734/1488] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1467 bytes in 2251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:09.378893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.380839 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:09.408350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.411789 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.416395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.418556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.419225 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.419847 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.485104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.486105 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:09.982332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:10.002077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:10.010417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:10.012432 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-07810e29-75e2-40c5-b821-826bd3eeaced tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1277 microversion: 2.57 time: 0.530972 Nov 02 12:43:10.013334 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 735/1489] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1277 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:43:10.023637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f7d2ba4a-23e3-458c-87eb-fff82babce97 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c21b1f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.124994 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4fa9746c-c207-402e-b6bc-f145ca407f01 tempest-ServersOnMultiNodesTest-1040632688 tempest-ServersOnMultiNodesTest-1040632688-project-admin] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1618 microversion: 2.1 time: 0.751214 Nov 02 12:43:10.130869 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 755/1490] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1618 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:10.132960 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f7d2ba4a-23e3-458c-87eb-fff82babce97 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.115186 Nov 02 12:43:10.133984 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 736/1491] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:10 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:10.173831 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.174339 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:10.217495 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.263944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.269790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.052s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.293869 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.294486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.297827 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.494939 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:11.059918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.062412 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.088729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.100782 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.101637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.104673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.107218 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.111995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.650473 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82baa140-81fd-4742-9302-52515aaf39ea tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 204 len: 0 microversion: 2.1 time: 1.485523 Nov 02 12:43:11.652268 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 737/1492] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:10 2022] DELETE /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 0 bytes in 1488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:11.661444 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66cc3e93-c61f-4887-b295-4f72bb2f4f9e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5cf90310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.847807 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66cc3e93-c61f-4887-b295-4f72bb2f4f9e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.192760 Nov 02 12:43:11.850767 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 738/1493] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:11 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:11.886796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:11.888363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:11.938599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.984372 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:11.990372 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:11.996172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:11.998248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.002133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:13.122119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.145220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.155808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.159204 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-459bf04f-96c6-4414-adc3-31f5e4421105 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1273 microversion: 2.57 time: 2.104921 Nov 02 12:43:13.176053 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 756/1494] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:11 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1273 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:13.202787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f4f4a0df-3802-40ed-98f4-039c5d04277a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1c0dc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:13.367638 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f4f4a0df-3802-40ed-98f4-039c5d04277a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.190040 Nov 02 12:43:13.378382 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 757/1495] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:13 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:13.962443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:13.982846 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b53d25bd-aaee-4836-924d-dfe5eaa39d55 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1473 microversion: 2.1 time: 2.128490 Nov 02 12:43:14.024785 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 739/1496] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:11 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1473 bytes in 2173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:14.211722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:14.213152 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:14.237634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.242710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.242710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:14.242710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:14.242710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:14.252930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:14.265066 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4166d4d3-b7bd-4c59-a789-77ed79b0dab7 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Action: 'create', calling method: .version_select at 0x7eff5c2149d0>, body: {"keypair": {"name": "tempest-keypair-445968444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9/vc/+68e1chSyRWeAp+WfyptXtm3nBy1zF/1syoJYjx1KnxXJbb+B0PN1N1fjkwUW1kxx6VqDO+D4D6LCfFJJDd2zKOpH2CeREiaxImGgryG6UQLRA5q/d8tZE0P4qw=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:14.353525 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-4166d4d3-b7bd-4c59-a789-77ed79b0dab7 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Getting quotas for project 9dae73b687df4626a377fcf4030f78a0. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:14.381491 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-4166d4d3-b7bd-4c59-a789-77ed79b0dab7 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Getting quotas for user 0f42c89a160549009239a40de8d5daa9 and project 9dae73b687df4626a377fcf4030f78a0. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:14.679182 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4166d4d3-b7bd-4c59-a789-77ed79b0dab7 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.622054 Nov 02 12:43:14.687228 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 758/1497] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:43:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:14.694249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-26647006-eecd-46e9-9fc4-28d96ad82f2c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:14.846864 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-26647006-eecd-46e9-9fc4-28d96ad82f2c tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.158183 Nov 02 12:43:14.847540 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 759/1498] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:14 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:14.917804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.952745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.966490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:14.974152 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c2712bc4-db3b-4fbe-8833-28265b67b675 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1335 microversion: 2.57 time: 0.770462 Nov 02 12:43:14.985293 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 740/1499] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:14 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1335 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:15.023926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:15.025109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:15.038224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.042969 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.055363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.078477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:15.079322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:15.080643 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:15.874634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-26a20813-fda5-473e-a467-89d5860c267d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c489790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.027439 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-26a20813-fda5-473e-a467-89d5860c267d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1455 microversion: 2.1 time: 0.163198 Nov 02 12:43:16.042362 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 741/1500] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:15 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:16.070524 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:16.091431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:16.105837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:16.119721 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.120355 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.124446 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.125277 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.125772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.126221 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.211790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:16.390523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.408508 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.409440 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.411553 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:16.413844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=72 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:16.415448 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c550e94c-b5ac-4de7-bc33-0089d85c782f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1335 microversion: 2.57 time: 0.367780 Nov 02 12:43:16.418540 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 742/1501] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:16 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:16.440071 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-03a96fa5-dfd0-4c66-943b-6e23307c2d05 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1473 microversion: 2.1 time: 1.420591 Nov 02 12:43:16.440717 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 760/1502] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:15 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1473 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:16.645306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17776d8a-ef14-463d-90d5-d1b086edd054", "name": "network-vif-deleted", "tag": "aba353f5-51f0-41f5-af78-c78549736744"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:16.676654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:16.677137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:16.681392 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:16.723621 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] Creating event network-vif-deleted:aba353f5-51f0-41f5-af78-c78549736744 for instance 17776d8a-ef14-463d-90d5-d1b086edd054 on n-h2-857339-6 Nov 02 12:43:16.738518 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-8a2c5945-5fa3-4d57-b6a0-923368f0afd9 req-ecebd98c-c8af-44fc-a5ac-61d93bec2927 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099187 Nov 02 12:43:16.739526 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 743/1503] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:17.049495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-51a068cf-c368-4c77-9345-4fdd2fe86330 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2aa700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.197540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:17.472231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:17.475988 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:17.500977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.508407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.508407 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:17.516191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:17.516191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:17.516191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.038217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:18.047571 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:18.063068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:18.080128 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-51ad784b-b1ce-477d-9ba1-10f8785b27c6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1356 microversion: 2.57 time: 0.618563 Nov 02 12:43:18.080770 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 744/1504] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1356 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:18.118766 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:18.124829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.163668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.164477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.183751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.183751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.196883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.201554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.410888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.412964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.413705 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.440879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid 17776d8a-ef14-463d-90d5-d1b086edd054 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:18.718187 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:18.732035 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7ea1fa01-80ec-4553-b3ff-badc154953c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 200 len: 1307 microversion: 2.1 time: 0.623220 Nov 02 12:43:18.739623 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 745/1505] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:18 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 1307 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:18.771046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:18.785145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:18.805692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.806570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.807430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:18.810359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:18.812158 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:18.820398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:19.990565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:24.439040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=12 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:25.030586 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=5 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:27.573011 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:28.900454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=11 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:29.861067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=25 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:36.504213 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-51a068cf-c368-4c77-9345-4fdd2fe86330 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1464 microversion: 2.1 time: 19.451087 Nov 02 12:43:36.508316 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 761/1506] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:17 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1464 bytes in 19467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:36.535153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:43:36.536159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:43:36.538847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:43:36.539531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:43:36.541073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:43:36.556397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:36.558070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 17776d8a-ef14-463d-90d5-d1b086edd054] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:36.579025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:36.579496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:36.579942 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:36.580804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:36.581302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:36.585585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:36.647191 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 HTTP/1.1 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '17776d8a-ef14-463d-90d5-d1b086edd054'} Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:36.651758 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. Nov 02 12:43:36.657945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:36.665667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance 17776d8a-ef14-463d-90d5-d1b086edd054 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:36.680111 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6c72a963-c127-46dc-bfda-8839f93c626f tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054" status: 404 len: 111 microversion: 2.1 time: 0.139218 Nov 02 12:43:36.684984 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 762/1507] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:36 2022] GET /compute/v2.1/servers/17776d8a-ef14-463d-90d5-d1b086edd054 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:36.713450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1993114590", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b73818dd-ad5f-4cb0-a704-da161faaa84f"}], "security_groups": [{"name": "tempest-securitygroup--1812732980"}], "key_name": "tempest-keypair-445968444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:36.998332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:37.047188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.052847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.053952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.057034 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.059444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] validate_networks() for [('b73818dd-ad5f-4cb0-a704-da161faaa84f', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:37.071773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.072234 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.165721 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3f722ca4-c40a-4071-b204-1dc2f80922d3 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "POST /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf/action" status: 202 len: 1137 microversion: 2.57 time: 18.422950 Nov 02 12:43:37.170440 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 746/1508] 10.222.0.64 () {62 vars in 1320 bytes} [Wed Nov 2 12:43:18 2022] POST /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf/action => generated 1137 bytes in 18428 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:37.659879 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd) Nov 02 12:43:37.667019 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.672862 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:37.672862 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Request method failure captured: Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 632 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmXhXMuCtKT1Yqozud7S3Jr3TuGJCHChCnaNjsWfdzXzdCG8mhzlcSfOyiTXo96OT2w_88K95XCrYGh9KeCbuAz-KVgJsZDtz-QzjukTxPOxjfgK_Kr1ZF76zzVLQz10TTLfPci9KS5oSP3V44AN3jmQN7wJFkN9TIhV8sKRknVWfFE Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9dae73b687df4626a377fcf4030f78a0 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersTestJSON-98098666 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9dae73b687df4626a377fcf4030f78a0", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9dae73b687df4626a377fcf4030f78a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9dae73b687df4626a377fcf4030f78a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9dae73b687df4626a377fcf4030f78a0"}]}] Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersTestJSON-98098666 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9dae73b687df4626a377fcf4030f78a0 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersTestJSON-98098666 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersTestJSON-98098666-project Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 0f42c89a160549009239a40de8d5daa9 Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersTestJSON-98098666-project Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersTestJSON-server-1993114590", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "E3%T8GbA*PMugty", "networks": [{"uuid": "b73818dd-ad5f-4cb0-a704-da161faaa84f"}], "security_groups": [{"name": "tempest-securitygroup--1812732980"}], "key_name": "tempest-keypair-445968444", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1993114590', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'E3%T8GbA*PMugty', 'networks': [{'uuid': 'b73818dd-ad5f-4cb0-a704-da161faaa84f'}], 'security_groups': [{'name': 'tempest-securitygroup--1812732980'}], 'key_name': 'tempest-keypair-445968444', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:37.684431 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ff1a019-f6a6-42ec-a875-6cc0fea426fd) Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.690377 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.696964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:37.701717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:37.701717 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:37.706676 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0901d45e-e793-4033-910d-8c2d727e89be tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.014702 Nov 02 12:43:37.706676 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 763/1509] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1017 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:43:37.726321 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bf20fe8c-7f89-4489-b7b1-e527971fbe0e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c274a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:37.858556 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bf20fe8c-7f89-4489-b7b1-e527971fbe0e tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 200 len: 1464 microversion: 2.1 time: 0.147748 Nov 02 12:43:37.863546 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 764/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:37 2022] GET /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 1464 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:37.884341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:37.887272 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:37.908711 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.909406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.909988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.916823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:37.917599 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:37.918171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:37.989067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:37.995977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4d4b4316-e2c8-4b16-a78d-1656e29d2977 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c1df9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1128962994", "description": "tempest-description-440698169"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:38.570155 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b3e4bd0b-9c13-42b9-81ae-9883851e6c15 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 204 len: 0 microversion: 2.1 time: 0.703588 Nov 02 12:43:38.570752 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 765/1511] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:37 2022] DELETE /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:38.578060 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:38.579045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:38.605960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.606475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.606931 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.607639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:38.608104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:38.608582 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:38.855944 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.950841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.964849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:38.974320 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-50602a13-a4d7-44d6-9374-9dc1b8dbf29f tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.398921 Nov 02 12:43:38.979702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 766/1512] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:38 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:39.009454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a4e1844c-eafd-4893-8db7-f6e78566e506 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] Calling method '.version_select at 0x7eff5c214f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.197593 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a4e1844c-eafd-4893-8db7-f6e78566e506 tempest-ServersTestJSON-98098666 tempest-ServersTestJSON-98098666-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445968444" status: 202 len: 0 microversion: 2.1 time: 0.212843 Nov 02 12:43:39.206651 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 767/1513] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445968444 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:39.223035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.224687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:39.243687 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.247717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.248302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.249110 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.256047 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.256553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.357822 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4d4b4316-e2c8-4b16-a78d-1656e29d2977 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.185966 Nov 02 12:43:39.358939 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 747/1514] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:43:37 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:39.410064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:39.411253 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:39.439267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.444589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.449991 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.453351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:39.454982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:39.456710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:39.608394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:39.617670 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-29344aa7-d557-4a71-af27-556dff64a2dc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1467 microversion: 2.1 time: 0.409100 Nov 02 12:43:39.621812 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 768/1515] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:39 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1467 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:39.634760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f67dea5b-970e-40fb-a502-57f31b3679cd tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c27a940>, body: {"security_group_rule": {"parent_group_id": "816a7117-a616-4a05-bff7-007d5b3b2aa8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:40.058466 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.087297 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c99b85a-1a29-460b-b66e-44b3f424960e tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1472 microversion: 2.1 time: 0.693347 Nov 02 12:43:40.090049 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 748/1516] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:39 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1472 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:40.108163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cb0a129a-0c12-403a-8815-ce3c26437064 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c24aa60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:40.395558 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cb0a129a-0c12-403a-8815-ce3c26437064 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?changes-since=2022-11-02T12%3A40%3A32Z" status: 200 len: 2329 microversion: 2.1 time: 0.302273 Nov 02 12:43:40.403710 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 749/1517] 10.222.0.64 () {58 vars in 1199 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/images?changes-since=2022-11-02T12%3A40%3A32Z => generated 2329 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:40.415973 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:40.426574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:40.446647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.451874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.451874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.451874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:40.455920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:40.456851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:40.753422 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.786333 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.794135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:40.801862 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-204a74ec-1ec6-4f53-8b34-d8335f1a340e tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.389767 Nov 02 12:43:40.802529 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 750/1518] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:40.824329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a591a89c-482b-48eb-9cdc-55f5af9bfdca tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.029675 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a591a89c-482b-48eb-9cdc-55f5af9bfdca tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-473400782" status: 200 len: 484 microversion: 2.1 time: 0.207141 Nov 02 12:43:41.030356 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 751/1519] 10.222.0.64 () {58 vars in 1229 bytes} [Wed Nov 2 12:43:40 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-473400782 => generated 484 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:41.050505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-701da2c3-7e6a-4afd-abc9-1158f5c2b828 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c4c9700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.201300 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f67dea5b-970e-40fb-a502-57f31b3679cd tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.578048 Nov 02 12:43:41.202050 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 769/1520] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:41.208949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.209912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:41.228957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.228957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.229322 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-701da2c3-7e6a-4afd-abc9-1158f5c2b828 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?server=56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 957 microversion: 2.1 time: 0.187181 Nov 02 12:43:41.229431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.238895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:41.239200 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 752/1521] 10.222.0.64 () {58 vars in 1209 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/images?server=56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 957 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:41.239884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:41.240528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:41.261990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff0eb25a-b475-4511-8075-38c324d16cd3 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c3a14c0>, body: {"security_group_rule": {"parent_group_id": "816a7117-a616-4a05-bff7-007d5b3b2aa8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:41.454965 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-ff0eb25a-b475-4511-8075-38c324d16cd3 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff0eb25a-b475-4511-8075-38c324d16cd3 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 138 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: {"security_group_rule": {"parent_group_id": "816a7117-a616-4a05-bff7-007d5b3b2aa8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: exception: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'security_group_rule': {'parent_group_id': '816a7117-a616-4a05-bff7-007d5b3b2aa8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:41.457596 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff0eb25a-b475-4511-8075-38c324d16cd3 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: This rule already exists in group 816a7117-a616-4a05-bff7-007d5b3b2aa8 {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ff0eb25a-b475-4511-8075-38c324d16cd3 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.218129 Nov 02 12:43:41.471334 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 753/1522] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:41 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:43:41.481810 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5e78355-d9be-4ee1-9e40-5fe26c9df196 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c24ae50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.610572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:41.641957 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-af7e3244-466f-4a9c-9963-dc1a309a5c71 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1472 microversion: 2.1 time: 0.438503 Nov 02 12:43:41.642894 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 770/1523] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:41.652592 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c5e78355-d9be-4ee1-9e40-5fe26c9df196 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fv2.1%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 485 microversion: 2.1 time: 0.186480 Nov 02 12:43:41.652898 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-437d6271-74fb-4eaf-b2fc-659720bb1037 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c27a790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.664851 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 754/1524] 10.222.0.64 () {58 vars in 1317 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fv2.1%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74 => generated 485 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:41.670303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f745130e-9333-4d32-8429-2ed835379c06 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:41.806646 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f745130e-9333-4d32-8429-2ed835379c06 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 485 microversion: 2.1 time: 0.139623 Nov 02 12:43:41.809511 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 755/1525] 10.222.0.64 () {58 vars in 1303 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74 => generated 485 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:41.829734 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b332fb9e-0eab-42ac-b8b2-593065339574 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c551e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b332fb9e-0eab-42ac-b8b2-593065339574 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.339695 Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 756/1526] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:43:41 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.224431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.353435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.380470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.397643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:42.403238 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cd34a778-57b8-49be-8a72-dd97a1cef9ba tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.237487 Nov 02 12:43:42.403238 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 757/1527] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:42.434830 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-437d6271-74fb-4eaf-b2fc-659720bb1037 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-group-rules/ad436b64-447f-40ad-9101-82d5e4df9610" status: 202 len: 0 microversion: 2.1 time: 0.789285 Nov 02 12:43:42.436422 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 771/1528] 10.222.0.64 () {58 vars in 1287 bytes} [Wed Nov 2 12:43:41 2022] DELETE /compute/v2.1/os-security-group-rules/ad436b64-447f-40ad-9101-82d5e4df9610 => generated 0 bytes in 792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:42.449073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1425828a-3ec8-4a53-b794-98c1e829778d tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c1f08b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-741985521", "description": "tempest-description-159511051"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:42.456013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-192321fd-f42e-4234-b61e-5857e45eb62b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c2094c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.723565 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-192321fd-f42e-4234-b61e-5857e45eb62b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.296569 Nov 02 12:43:42.735037 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 758/1529] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:42.753543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a20af1-ba94-4459-8b9b-5f170a876caa", "name": "network-vif-deleted", "tag": "d727cd98-7b6e-45c4-ba61-de6bced45d8d"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:42.793531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.794390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.795041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.842869 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] Creating event network-vif-deleted:d727cd98-7b6e-45c4-ba61-de6bced45d8d for instance c1a20af1-ba94-4459-8b9b-5f170a876caa on n-h1-857339-6 Nov 02 12:43:42.857645 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-e2a945da-de52-43bb-a78a-f44e9563ec31 req-de50d7cc-8b65-402a-aaec-1790528c08c0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118970 Nov 02 12:43:42.861417 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 759/1530] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:42.874899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:42.875995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:42.894544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.895431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.896235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:42.899637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:42.900420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:42.901218 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.066838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.079889 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4033a92e-1286-442d-8fb9-08699d9209c8 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1301 microversion: 2.1 time: 0.215724 Nov 02 12:43:43.081544 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 760/1531] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:42 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1301 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:43.090897 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-97b153ea-53ea-43e2-b080-af83b59d0f2d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c24aa60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.186387 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1425828a-3ec8-4a53-b794-98c1e829778d tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.742329 Nov 02 12:43:43.200315 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 772/1532] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:43:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:43.206234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-22da4d11-9c99-4b0c-8ca8-a88e73579a99 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c1f09d0>, body: {"security_group_rule": {"parent_group_id": "18eda4f9-1b86-4c50-aab5-e6f625a82035", "ip_protocol": "tcp", "from_port": 1319831109, "to_port": 22}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:43.237836 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-97b153ea-53ea-43e2-b080-af83b59d0f2d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images?limit=1" status: 200 len: 575 microversion: 2.1 time: 0.154904 Nov 02 12:43:43.241211 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 761/1533] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/images?limit=1 => generated 575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:43.256137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-11ccf561-78f0-46e2-93c0-c6426a1d9378 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c389280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.343042 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-22da4d11-9c99-4b0c-8ca8-a88e73579a99 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Invalid port range 1319831109:22. Former value cannot be greater than the later Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-22da4d11-9c99-4b0c-8ca8-a88e73579a99 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 146 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: {"security_group_rule": {"parent_group_id": "18eda4f9-1b86-4c50-aab5-e6f625a82035", "ip_protocol": "tcp", "from_port": 1319831109, "to_port": 22}} Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid port range 1319831109:22. Former value cannot be greater than the later Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'security_group_rule': {'parent_group_id': '18eda4f9-1b86-4c50-aab5-e6f625a82035', 'ip_protocol': 'tcp', 'from_port': 1319831109, 'to_port': 22}}} Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1319831109:22. Former value cannot be greater than the later Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1319831109:22. Former value cannot be greater than the later Nov 02 12:43:43.345247 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1319831109:22. Former value cannot be greater than the later Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-22da4d11-9c99-4b0c-8ca8-a88e73579a99 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: Invalid port range 1319831109:22. Former value cannot be greater than the later {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-22da4d11-9c99-4b0c-8ca8-a88e73579a99 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.145181 Nov 02 12:43:43.357917 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 773/1534] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:43 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:43:43.359854 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d547e5aa-c763-430c-a26d-4b473e182d27 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c1c0430>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2070780225", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:43.362831 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-d547e5aa-c763-430c-a26d-4b473e182d27 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Security group id should be uuid Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d547e5aa-c763-430c-a26d-4b473e182d27 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 131 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2070780225", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: exception: Security group id should be uuid Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2070780225', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:43.364656 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:43.370727 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Nov 02 12:43:43.370727 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:43.370727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d547e5aa-c763-430c-a26d-4b473e182d27 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: Security group id should be uuid {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:43.370727 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d547e5aa-c763-430c-a26d-4b473e182d27 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.015985 Nov 02 12:43:43.370727 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 774/1535] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:43 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:43.381754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dcf1d1ca-9a21-452a-879b-3dbb29b0bef2 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c1f09d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-947321225", "description": "tempest-description-450915701"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:43.410475 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-11ccf561-78f0-46e2-93c0-c6426a1d9378 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A40%3A25Z" status: 200 len: 7013 microversion: 2.1 time: 0.161912 Nov 02 12:43:43.411407 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 762/1536] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-11-02T12%3A40%3A25Z => generated 7013 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:43.434252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-071f4b60-be8f-4c33-a1f0-ae23e1ab8ddd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c559700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.535738 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-071f4b60-be8f-4c33-a1f0-ae23e1ab8ddd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-473400782" status: 200 len: 664 microversion: 2.1 time: 0.106565 Nov 02 12:43:43.538350 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 763/1537] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-473400782 => generated 664 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:43.554714 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.555623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:43.577996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.578964 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.579704 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.581735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:43.585875 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:43.587312 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:43.849352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.856441 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.867332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:43.887030 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-350a9f29-3d97-4915-afbd-e82695a851ca tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.344879 Nov 02 12:43:43.903819 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 764/1538] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:43.904358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7bf572ba-8718-4b66-a3b8-6e8fef95d1c0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c239550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:43.975495 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7bf572ba-8718-4b66-a3b8-6e8fef95d1c0 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fv2.1%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1467 microversion: 2.1 time: 0.082732 Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 765/1539] 10.222.0.64 () {58 vars in 1338 bytes} [Wed Nov 2 12:43:43 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fv2.1%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74 => generated 1467 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-unplugged", "status": "completed", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] Creating event network-vif-unplugged:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:43:44.018552 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-4d802b15-4a1a-4dc6-b32c-e377a1d45591 req-95f0da87-ffd4-4ab9-9da3-5b7f50759bbc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040275 Nov 02 12:43:44.019315 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 766/1540] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:44.025787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6b236aa-57ef-44fd-9a62-35e711e8c552 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c21b1f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.081806 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e6b236aa-57ef-44fd-9a62-35e711e8c552 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1467 microversion: 2.1 time: 0.060916 Nov 02 12:43:44.082866 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 767/1541] 10.222.0.64 () {58 vars in 1324 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.64%2Fcompute%2Fservers%2F3918a345-1137-499b-a19a-da0d58f91a74 => generated 1467 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.102020 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af2c50f4-9ea4-47aa-9898-252af068133f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c389280>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.231589 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-af2c50f4-9ea4-47aa-9898-252af068133f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.133232 Nov 02 12:43:44.233794 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 768/1542] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.256037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.257505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:44.268680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.269592 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.270106 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.270920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.271576 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.272093 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.315745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.315745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.315745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.317113 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid c1a20af1-ba94-4459-8b9b-5f170a876caa {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:44.362297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:44.373550 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6cf408af-ebf9-4b5e-b9ac-d2ba953a4f3b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 200 len: 1306 microversion: 2.1 time: 0.137983 Nov 02 12:43:44.381150 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 769/1543] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 1306 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.381716 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6960fd1c-09fa-4998-9040-c557a87c6bcb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c605a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.460571 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6960fd1c-09fa-4998-9040-c557a87c6bcb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.083512 Nov 02 12:43:44.473199 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 770/1544] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:44.678008 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dcf1d1ca-9a21-452a-879b-3dbb29b0bef2 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.291131 Nov 02 12:43:44.694941 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 775/1545] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:43:43 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:44.711238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a4fed0a9-3372-4bf2-abb2-c4adc5997690 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c1f0430>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.758135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fa20f7da-6473-4936-ba57-de886219e2fe tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Action: 'create', calling method: .version_select at 0x7eff5c21b160>, body: {"keypair": {"name": "tempest-keypair-230839213", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMRF/VLkYxd7Qi8j5F4Rs5Kgh09f+VxsIIfn843qoy/1BV0br5WYd1wUxweoljQRsVCCyhtFbQ6150UwHU+A6ayKwF+wyDIh5Su5y6AFEys8SqA68e69DAkKbWEWr1/vdQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:44.782139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-fa20f7da-6473-4936-ba57-de886219e2fe tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Getting quotas for project 1d65446c687345bf995d7e3d6d882c4e. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:44.789932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-fa20f7da-6473-4936-ba57-de886219e2fe tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Getting quotas for user 6f3641a551df479f888d89f9d43bf6a7 and project 1d65446c687345bf995d7e3d6d882c4e. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:44.892707 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fa20f7da-6473-4936-ba57-de886219e2fe tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.417816 Nov 02 12:43:44.898202 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 771/1546] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:43:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:44.911203 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a4fed0a9-3372-4bf2-abb2-c4adc5997690 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067" status: 200 len: 784 microversion: 2.1 time: 0.213799 Nov 02 12:43:44.911808 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 776/1547] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/images/f990171d-1f62-41c4-b6db-f21083f74067 => generated 784 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:44.928221 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b475beb-60e4-422e-b5ad-04ec4c4bdc77 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c4c9700>, body: {"security_group_rule": {"parent_group_id": "f7736b97-bca1-4b60-835c-4124a6ef55e6", "ip_protocol": "tempest-999-1132885652", "from_port": 22, "to_port": 22}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:44.934373 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:44.935384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:44.957064 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.966540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.969740 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:44.974037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:44.978275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:44.978275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:45.049685 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-2b475beb-60e4-422e-b5ad-04ec4c4bdc77 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Invalid IP protocol tempest-999-1132885652. Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b475beb-60e4-422e-b5ad-04ec4c4bdc77 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 157 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: {"security_group_rule": {"parent_group_id": "f7736b97-bca1-4b60-835c-4124a6ef55e6", "ip_protocol": "tempest-999-1132885652", "from_port": 22, "to_port": 22}} Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid IP protocol tempest-999-1132885652. Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f7736b97-bca1-4b60-835c-4124a6ef55e6', 'ip_protocol': 'tempest-999-1132885652', 'from_port': 22, 'to_port': 22}}} Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1132885652. Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1132885652. Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:45.052888 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1132885652. Nov 02 12:43:45.058507 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:45.060845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2b475beb-60e4-422e-b5ad-04ec4c4bdc77 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: Invalid IP protocol tempest-999-1132885652. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:45.061936 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2b475beb-60e4-422e-b5ad-04ec4c4bdc77 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.166104 Nov 02 12:43:45.064307 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 772/1548] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:44 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:43:45.072571 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-90f2eeec-98d9-435a-b4c8-093dcd419025 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c605a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:45.112841 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.128455 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.130159 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:45.140827 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b01fec11-090d-4d43-a51c-3e79ad8e13de tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.204353 Nov 02 12:43:45.148793 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-90f2eeec-98d9-435a-b4c8-093dcd419025 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 835 microversion: 2.1 time: 0.084984 Nov 02 12:43:45.156717 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 773/1549] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:43:45 2022] GET /compute/v2.1/images/detail?limit=1 => generated 835 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:45.160636 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 777/1550] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:44 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:45.176500 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-95b7db78-3aa6-4f50-9a4a-764c62a2f4cc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5ce48790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:45.177045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3a6c0a60-a093-47f1-b3a9-dd3a0f6a1e37 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c21b1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1123356185", "description": "tempest-description-508311867"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:46.197155 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3a6c0a60-a093-47f1-b3a9-dd3a0f6a1e37 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.037874 Nov 02 12:43:46.206165 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 774/1551] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:43:45 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:46.212046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:46.214468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: c1a20af1-ba94-4459-8b9b-5f170a876caa] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:46.221597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.222082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.222621 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.223581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.224265 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.224917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.268863 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa HTTP/1.1 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'c1a20af1-ba94-4459-8b9b-5f170a876caa'} Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:46.270806 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. Nov 02 12:43:46.274572 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.277856 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance c1a20af1-ba94-4459-8b9b-5f170a876caa could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:46.279017 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d22c3666-78ce-4ac2-bb26-d5eb8b134148 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa" status: 404 len: 111 microversion: 2.1 time: 0.071223 Nov 02 12:43:46.281324 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 775/1552] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:46 2022] GET /compute/v2.1/servers/c1a20af1-ba94-4459-8b9b-5f170a876caa => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:46.288828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:46.301453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:46.311210 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.311665 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.312121 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.314160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.314691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.315133 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.458417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.467239 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.468823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:46.470055 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-39a8145d-533d-4005-9abc-eb18e5effd92 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1365 microversion: 2.57 time: 0.187730 Nov 02 12:43:46.471581 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 776/1553] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:46 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:46.476573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-02f1ac31-eab2-4576-a63c-12b0d042142c tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c4c9ee0>, body: {"security_group_rule": {"parent_group_id": "36c255ea-0a40-406e-9552-eb768fb95ea7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:46.731214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-02f1ac31-eab2-4576-a63c-12b0d042142c tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-02f1ac31-eab2-4576-a63c-12b0d042142c tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 138 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: {"security_group_rule": {"parent_group_id": "36c255ea-0a40-406e-9552-eb768fb95ea7", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'security_group_rule': {'parent_group_id': '36c255ea-0a40-406e-9552-eb768fb95ea7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:43:46.734069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Nov 02 12:43:46.737794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:46.740948 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-02f1ac31-eab2-4576-a63c-12b0d042142c tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:46.742754 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-02f1ac31-eab2-4576-a63c-12b0d042142c tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.270104 Nov 02 12:43:46.743915 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 777/1554] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:46 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 272 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:43:46.752731 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:46.754915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:46.770269 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.773776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.776473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.779706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:46.787156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:46.788866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:46.847614 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:47.421250 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-609ecbb4-4e9b-4b65-a936-389f84215aeb tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 204 len: 0 microversion: 2.1 time: 0.673414 Nov 02 12:43:47.423499 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 778/1555] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:46 2022] DELETE /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 0 bytes in 676 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:47.436250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94937176-9fe8-4e72-8eb6-f928fac9cdfe tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c489040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2050865417", "description": "tempest-description-907255805"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:47.906915 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-95b7db78-3aa6-4f50-9a4a-764c62a2f4cc tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008" status: 204 len: 0 microversion: 2.1 time: 2.742345 Nov 02 12:43:47.917262 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 778/1556] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:45 2022] DELETE /compute/v2.1/images/38cb7f58-3f8d-4741-85ea-1ed27bd91008 => generated 0 bytes in 2744 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:48.422223 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-94937176-9fe8-4e72-8eb6-f928fac9cdfe tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.983705 Nov 02 12:43:48.422951 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 779/1557] 10.222.0.64 () {60 vars in 1180 bytes} [Wed Nov 2 12:43:47 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:48.436168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.444724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:48.450957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-01d52ab6-6044-4dda-b985-f484d595c09b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Action: 'create', calling method: .version_select at 0x7eff5c38a3a0>, body: {"keypair": {"name": "tempest-keypair-401687108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLggl3CXPgAbDHTjjgjyCjKLcuAU345oOLAJWpQCymZX0HU+8FMGzTJyzq7yLXjMc0mBq8e5dJmQGWpl72h+6wPNlsY8Oh70fa4Tf9m99+lwtRGsm8hvvjk+ACmt0Zt2uQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:48.460783 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.461430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.462099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.463096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.464015 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.464693 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.508892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-01d52ab6-6044-4dda-b985-f484d595c09b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Getting quotas for project 0ff598bce6e74831be9e50484b4075d2. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:43:48.523834 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-01d52ab6-6044-4dda-b985-f484d595c09b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Getting quotas for user d3f905a0f01e4ad191eb456ea9aec7ca and project 0ff598bce6e74831be9e50484b4075d2. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:43:48.657681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.672976 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d2de2921-4a72-4915-b1ed-00f076b6c212 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1472 microversion: 2.1 time: 0.248719 Nov 02 12:43:48.680267 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 780/1558] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:48 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:48.694298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.695432 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:48.705979 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-01d52ab6-6044-4dda-b985-f484d595c09b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.797272 Nov 02 12:43:48.707785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.708496 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 779/1559] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:43:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:48.721229 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-969146e5-0198-4b89-ad2b-7fe506cc2bd4 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c214a60>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:48.727609 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.728174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.728998 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:48.729597 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:48.730010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:48.889329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.900886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.912726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:48.916919 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fb492048-1abb-4e2b-b794-3dfc49e11149 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1371 microversion: 2.57 time: 0.229175 Nov 02 12:43:48.920577 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 781/1560] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:48 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:48.933991 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e487ffb0-f3c7-4606-9c7e-8f33208c4ba5 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c605b80>, body: {"security_group_rule": {"parent_group_id": "fd53516c-f391-4231-be2d-a389684aeb21", "ip_protocol": "tcp", "from_port": 22, "to_port": 2005480700}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:49.239772 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-e487ffb0-f3c7-4606-9c7e-8f33208c4ba5 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e487ffb0-f3c7-4606-9c7e-8f33208c4ba5 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 146 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: {"security_group_rule": {"parent_group_id": "fd53516c-f391-4231-be2d-a389684aeb21", "ip_protocol": "tcp", "from_port": 22, "to_port": 2005480700}} Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fd53516c-f391-4231-be2d-a389684aeb21', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 2005480700}}} Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 Nov 02 12:43:49.242676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 Nov 02 12:43:49.246882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.248360 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e487ffb0-f3c7-4606-9c7e-8f33208c4ba5 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 400 to user: Invalid port range 22:2005480700. Valid TCP ports should be between 1-65535 {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:49.249513 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e487ffb0-f3c7-4606-9c7e-8f33208c4ba5 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.327496 Nov 02 12:43:49.251287 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 782/1561] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:48 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 330 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:43:49.268929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Action: 'create', calling method: .version_select at 0x7eff5c5518b0>, body: {"security_group_rule": {"parent_group_id": "bf53868e-a944-4277-a447-5a5d27359f08", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:49.314329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:49.315160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Neutron security group bf53868e-a944-4277-a447-5a5d27359f08 not found {{(pid=127767) get /opt/stack/nova/nova/network/security_group_api.py:313}} Nov 02 12:43:49.316083 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.316083 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 138 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: {"security_group_rule": {"parent_group_id": "bf53868e-a944-4277-a447-5a5d27359f08", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bf53868e-a944-4277-a447-5a5d27359f08', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:49.318959 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 404 to user: Security group bf53868e-a944-4277-a447-5a5d27359f08 does not exist Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-6b0e0b68-a469-4358-9120-642a4e8b5662'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3e519100-6bc2-4525-9942-793890617435 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.057691 Nov 02 12:43:49.330990 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 783/1562] 10.222.0.64 () {60 vars in 1195 bytes} [Wed Nov 2 12:43:49 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:49.345140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c516700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:49.377415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:43:49.378396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.security_group_api [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Neutron security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f not found {{(pid=127767) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Nov 02 12:43:49.379395 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] HTTP exception thrown: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.379395 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Request method failure captured: Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-security-group-rules/d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f HTTP/1.1 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmXypqgtRkCk1CP-XkOXXRgICT275HXN9d6BxgugN7boUkfv9c1jnqkmLFr5U_cARONS58a-2C7LFhcOHoMygXmaBZmBBWdmtmOPM3dtqv35hjoOEtZh8FX5Z3FATIyJAsSG7tBuQfYXMBk0WRTtPZ8mnKS2qNdhIFBKVRfQ-GLozqQ Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2449c558939943129ecf0b6db5251e60", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2449c558939943129ecf0b6db5251e60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2449c558939943129ecf0b6db5251e60"}]}] Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2449c558939943129ecf0b6db5251e60 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 66e1e5c8ae83452cb36701b0f335d8a2 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: exception: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'd35a0735-d9dc-43a0-80f7-4bcfa0edbc6f'} Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:43:49.382519 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] Nov 02 12:43:49.386051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:49.393540 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Returning 404 to user: Security group rule d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f does not exist Nov 02 12:43:49.393540 n-d-857339-6 devstack@n-api.service[127767]: Neutron server returns request_ids: ['req-0f9d4243-7e65-409e-a33e-6f9e0d40f42a'] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:49.394983 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-00857a56-69db-4beb-9e9b-96b9bb8bdf82 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-group-rules/d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f" status: 404 len: 199 microversion: 2.1 time: 0.062430 Nov 02 12:43:49.395779 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 784/1563] 10.222.0.64 () {58 vars in 1287 bytes} [Wed Nov 2 12:43:49 2022] DELETE /compute/v2.1/os-security-group-rules/d35a0735-d9dc-43a0-80f7-4bcfa0edbc6f => generated 199 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:49.413311 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b0bda87b-f927-410b-bcdc-f510dc2bdeba tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5cf908b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.031921 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b0bda87b-f927-410b-bcdc-f510dc2bdeba tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/fd53516c-f391-4231-be2d-a389684aeb21" status: 202 len: 0 microversion: 2.1 time: 0.628038 Nov 02 12:43:50.036101 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 785/1564] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:49 2022] DELETE /compute/v2.1/os-security-groups/fd53516c-f391-4231-be2d-a389684aeb21 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:50.058701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-361880150", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "084316a1-9860-4bda-8dc9-91f9a79044cc"}], "security_groups": [{"name": "tempest-securitygroup--933403774"}], "key_name": "tempest-keypair-230839213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:50.272814 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] validate_networks() for [('084316a1-9860-4bda-8dc9-91f9a79044cc', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:50.837642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f) Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Request method failure captured: Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 638 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmYAXefqcNZVPfsmrsrP3sYpkZjfHWqa1dY8L7gK7HRmGE5DzSgK9SZNPifP96pKS5u5FGnELms_fxDwZsYryr_8LLeCnXf2nF5yZYjx5DmmrGEct4H2-sXwGaCap6HzdmVxn6AlgGirnnNalRixqWCdxdlKAwZ-6PTLOh6SgTuI34w Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 1d65446c687345bf995d7e3d6d882c4e Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestManualDisk-540857778 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1d65446c687345bf995d7e3d6d882c4e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d65446c687345bf995d7e3d6d882c4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1d65446c687345bf995d7e3d6d882c4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1d65446c687345bf995d7e3d6d882c4e"}]}] Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestManualDisk-540857778 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 1d65446c687345bf995d7e3d6d882c4e Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestManualDisk-540857778 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestManualDisk-540857778-project Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6f3641a551df479f888d89f9d43bf6a7 Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestManualDisk-540857778-project Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestManualDisk-server-361880150", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "H8^GBy2MLO!NqR3", "networks": [{"uuid": "084316a1-9860-4bda-8dc9-91f9a79044cc"}], "security_groups": [{"name": "tempest-securitygroup--933403774"}], "key_name": "tempest-keypair-230839213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:43:50.849812 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestManualDisk-server-361880150', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'metadata': {'hello': 'world'}, 'adminPass': 'H8^GBy2MLO!NqR3', 'networks': [{'uuid': '084316a1-9860-4bda-8dc9-91f9a79044cc'}], 'security_groups': [{'name': 'tempest-securitygroup--933403774'}], 'key_name': 'tempest-keypair-230839213', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:50.861664 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9efacd83-eb29-4728-9fcd-07e2fc74eb3f) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c3d25ff-397d-48cb-b1fb-9e70872f6141 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.804892 Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 786/1565] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 807 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:43:50.876344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:50.879270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.003744 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.028053 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-64a5cbe2-1d03-49b8-acc8-90840029d40b tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 200 len: 1430 microversion: 2.1 time: 0.182843 Nov 02 12:43:51.042887 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 787/1566] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:50 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 1430 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:51.065712 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.069858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:51.092931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.093680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.094435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.095675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.096559 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.107273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.121807 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:51.155120 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-969146e5-0198-4b89-ad2b-7fe506cc2bd4 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10" status: 204 len: 0 microversion: 2.1 time: 2.445234 Nov 02 12:43:51.156550 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 780/1567] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:48 2022] DELETE /compute/v2.1/images/dfca8563-04ea-4885-a9d5-e5f2b8bb5c10 => generated 0 bytes in 2447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:51.164513 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec7c137c-9c54-4b69-a581-3281148b4f66 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c14a310>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.282040 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.295356 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.298954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:51.302696 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-844d3b43-3307-4bb0-ad46-3a165fb59b84 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1356 microversion: 2.57 time: 0.249087 Nov 02 12:43:51.305232 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 788/1568] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:51 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1356 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:51.327532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f658ca6f-7387-44fd-b531-ba529ad2f0e2 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] Calling method '.version_select at 0x7eff5c635a60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.471093 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f658ca6f-7387-44fd-b531-ba529ad2f0e2 tempest-ServersTestManualDisk-540857778 tempest-ServersTestManualDisk-540857778-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-230839213" status: 202 len: 0 microversion: 2.1 time: 0.162074 Nov 02 12:43:51.472566 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 789/1569] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:43:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-230839213 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:51.484412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-66b34cef-c31c-4db2-8db6-3dc6b0fc1f91 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c68c0d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.771317 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ec7c137c-9c54-4b69-a581-3281148b4f66 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/36c255ea-0a40-406e-9552-eb768fb95ea7" status: 202 len: 0 microversion: 2.1 time: 0.613532 Nov 02 12:43:51.771869 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 781/1570] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:51 2022] DELETE /compute/v2.1/os-security-groups/36c255ea-0a40-406e-9552-eb768fb95ea7 => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:51.786832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c033efb-fdb4-4b0e-8da4-66f022ad5d1c", "name": "network-vif-deleted", "tag": "f6a28c90-4c20-4523-ad16-8dc19c482ea1"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:51.829128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.829630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.830065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.857168 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] Creating event network-vif-deleted:f6a28c90-4c20-4523-ad16-8dc19c482ea1 for instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c on n-h1-857339-6 Nov 02 12:43:51.877960 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-02d2723b-8958-4a6c-8ae8-d382440b904c req-76105911-2748-49c4-9e20-a0a028728093 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100610 Nov 02 12:43:51.881201 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 782/1571] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:51.899560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:51.899560 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:51.926829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.927811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.928769 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.929792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:51.930892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:51.931678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:51.969800 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:52.397578 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66600f5a-6e0f-44d0-acb8-21fa961c2f17 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 204 len: 0 microversion: 2.57 time: 0.514215 Nov 02 12:43:52.403586 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 783/1572] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:43:51 2022] DELETE /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:43:52.414998 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c1185169-04e8-411e-99f1-5c225b950a93 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c18e700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.217055 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c1185169-04e8-411e-99f1-5c225b950a93 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/f7736b97-bca1-4b60-835c-4124a6ef55e6" status: 202 len: 0 microversion: 2.1 time: 0.811249 Nov 02 12:43:53.217831 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 784/1573] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:52 2022] DELETE /compute/v2.1/os-security-groups/f7736b97-bca1-4b60-835c-4124a6ef55e6 => generated 0 bytes in 815 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:53.224241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.229982 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.239955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.240866 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.251902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.255539 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.258965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.259811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.305325 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c HTTP/1.1 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '6c033efb-fdb4-4b0e-8da4-66f022ad5d1c'} Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:53.309161 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. Nov 02 12:43:53.313084 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:53.316296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance 6c033efb-fdb4-4b0e-8da4-66f022ad5d1c could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:53.317219 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5fb75b6b-6178-47b2-bbd9-816fdc657057 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c" status: 404 len: 111 microversion: 2.1 time: 0.097163 Nov 02 12:43:53.317801 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 785/1574] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/6c033efb-fdb4-4b0e-8da4-66f022ad5d1c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:53.325325 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.326605 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:53.335453 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.336481 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.337751 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.338767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:53.339383 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:53.340729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:53.442287 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.461649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.465146 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:53.467504 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4f0dc8b3-5365-4ac3-8dc4-8a21dc57dcf6 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1362 microversion: 2.57 time: 0.147918 Nov 02 12:43:53.468445 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 786/1575] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:53 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:53.477291 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e3f6f54d-6772-42ff-b1fe-063e6132a3dc tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c14a5e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:53.683722 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-66b34cef-c31c-4db2-8db6-3dc6b0fc1f91 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce" status: 204 len: 0 microversion: 2.1 time: 2.208946 Nov 02 12:43:53.691562 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 790/1576] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:51 2022] DELETE /compute/v2.1/images/e9d7f9de-34d2-48e0-9b64-91a6dc4839ce => generated 0 bytes in 2211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:53.934614 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e3f6f54d-6772-42ff-b1fe-063e6132a3dc tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/18eda4f9-1b86-4c50-aab5-e6f625a82035" status: 202 len: 0 microversion: 2.1 time: 0.464607 Nov 02 12:43:53.940752 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 787/1577] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:53 2022] DELETE /compute/v2.1/os-security-groups/18eda4f9-1b86-4c50-aab5-e6f625a82035 => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:53.962180 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1365672995", "imageRef": "39580bbe-cb5d-4433-ae9f-0c0ddd478e6e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "432cbf6f-2314-438f-8ea2-0de141f865a8"}], "security_groups": [{"name": "tempest-securitygroup--199884913"}], "key_name": "tempest-keypair-401687108", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:54.062014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.062529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.093671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.093671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.093671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.093951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.098848 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.101090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.116406 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] validate_networks() for [('432cbf6f-2314-438f-8ea2-0de141f865a8', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:43:54.170169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1198aa3-1625-43f0-a28e-62690b845ed6) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:54.436628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1198aa3-1625-43f0-a28e-62690b845ed6) Nov 02 12:43:54.439206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.441732 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:54.441732 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Request method failure captured: Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 485 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmWzFc5zIVEMSYBzU33LwwqaLzROHDtunfTaiFQI8VKcS48QObMxm8CAePWmfWyluBKebhNVwMPDdMeGVEjr8NpT2WfXSLj6KXIiIwcz67S66FL1F-qcXrhpkS_A3UOF7nLMOwBV4fX7jhx4AFHyYJrZKAB9Vk65Z9-izVU4hbmwS6Q Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 0ff598bce6e74831be9e50484b4075d2 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1643555458 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0ff598bce6e74831be9e50484b4075d2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0ff598bce6e74831be9e50484b4075d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0ff598bce6e74831be9e50484b4075d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0ff598bce6e74831be9e50484b4075d2"}]}] Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1643555458 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 0ff598bce6e74831be9e50484b4075d2 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1643555458 Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AttachSCSIVolumeTestJSON-1643555458-project Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: d3f905a0f01e4ad191eb456ea9aec7ca Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1643555458-project Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1365672995", "imageRef": "39580bbe-cb5d-4433-ae9f-0c0ddd478e6e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "432cbf6f-2314-438f-8ea2-0de141f865a8"}], "security_groups": [{"name": "tempest-securitygroup--199884913"}], "key_name": "tempest-keypair-401687108", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-AttachSCSIVolumeTestJSON-server-1365672995', 'imageRef': '39580bbe-cb5d-4433-ae9f-0c0ddd478e6e', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '432cbf6f-2314-438f-8ea2-0de141f865a8'}], 'security_groups': [{'name': 'tempest-securitygroup--199884913'}], 'key_name': 'tempest-keypair-401687108', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:43:54.445318 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-d1198aa3-1625-43f0-a28e-62690b845ed6) Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:54.449757 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.457129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:54.462911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:43:54.462911 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:54.465604 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0a2e51db-ea2b-4480-969e-3c8b0f32ebc6 tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.523077 Nov 02 12:43:54.469794 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 788/1578] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:43:53 2022] POST /compute/v2.1/servers => generated 214 bytes in 527 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:43:54.477565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.478415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:54.488619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.489259 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.490388 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.491416 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:54.492088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:54.492894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:54.551673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:54.610462 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ff1f9cf9-86eb-48d3-b998-b63b08fc6b22 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 204 len: 0 microversion: 2.1 time: 0.924072 Nov 02 12:43:54.611530 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 791/1579] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:53 2022] DELETE /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:54.619804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-affdd324-d602-42ea-af96-6a8398455ec7 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] Calling method '.version_select at 0x7eff5c4ee820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:54.803495 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:55.072737 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-affdd324-d602-42ea-af96-6a8398455ec7 tempest-SecurityGroupRulesNegativeTestJSON-1199332641 tempest-SecurityGroupRulesNegativeTestJSON-1199332641-project] 10.222.0.64 "DELETE /compute/v2.1/os-security-groups/816a7117-a616-4a05-bff7-007d5b3b2aa8" status: 202 len: 0 microversion: 2.1 time: 0.459297 Nov 02 12:43:55.075088 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 792/1580] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:54 2022] DELETE /compute/v2.1/os-security-groups/816a7117-a616-4a05-bff7-007d5b3b2aa8 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:55.081543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9a6455d7-a8b9-4458-849d-c7ca9b78979b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] Calling method '.version_select at 0x7eff5c673430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.099824 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-601a0c86-21ad-4762-a40e-fdf60348967a tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 204 len: 0 microversion: 2.1 time: 0.628112 Nov 02 12:43:55.100934 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 789/1581] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:54 2022] DELETE /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:55.113294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.114245 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.130893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.133771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.134711 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.136116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.145326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.145817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.226167 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.226772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.227166 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.227754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lazy-loading 'fault' on Instance uuid 8482cecf-ebd5-416c-8a38-d5e056f88bbf {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:55.248222 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9a6455d7-a8b9-4458-849d-c7ca9b78979b tempest-AttachSCSIVolumeTestJSON-1643555458 tempest-AttachSCSIVolumeTestJSON-1643555458-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401687108" status: 202 len: 0 microversion: 2.1 time: 0.171684 Nov 02 12:43:55.263700 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 793/1582] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:43:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401687108 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:55.263700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.263700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.275980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.276625 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.280527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.281593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.282194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.282645 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.340650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.341263 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:55.356367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.359963 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.366504 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e00016e1-b5f4-482d-a4d4-c3da5e935a60 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1367 microversion: 2.57 time: 0.261245 Nov 02 12:43:55.367329 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 790/1583] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:55.385499 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.386411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.398247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.398860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.400649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.403795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.404352 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.404832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.785396 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bdf746d5-cd14-485c-ae46-d972e1087d13 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 204 len: 0 microversion: 2.1 time: 0.535154 Nov 02 12:43:55.795790 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 794/1584] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:55 2022] DELETE /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:55.810225 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:55.812402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:55.825013 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:55.827358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.828519 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.832086 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.833149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:55.840915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:55.840915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:55.841051 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a3fdf1b3-6385-48fe-a3c6-50d2f06157ae tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1474 microversion: 2.1 time: 0.471789 Nov 02 12:43:55.841510 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 791/1585] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1474 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:56.397144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.397710 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.410096 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.410596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.411034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.411966 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.412297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.412814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.418309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:56.485091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.485296 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.485572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.492413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.492413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lazy-loading 'fault' on Instance uuid 8482cecf-ebd5-416c-8a38-d5e056f88bbf {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:56.501972 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-947b4781-da6d-4162-9fac-894fe177bdfe tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 200 len: 1474 microversion: 2.1 time: 0.699977 Nov 02 12:43:56.504967 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 795/1586] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:55 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 1474 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:56.726443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.747714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.750347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:56.751964 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b062a4ee-cd2b-47f9-87b7-102db4591f9c tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1367 microversion: 2.57 time: 0.360001 Nov 02 12:43:56.777423 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 792/1587] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:56.870813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:56.872844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:56.896045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.897585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.899684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:56.906250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:56.908787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:56.909481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.272457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:57.284009 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6365dd2d-beb6-4f9d-97a8-142820d233b2 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1474 microversion: 2.1 time: 0.421074 Nov 02 12:43:57.290401 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 796/1588] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:56 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1474 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:57.532075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.533770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.557587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:57.575829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.576427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.580283 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.582825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.583636 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.584302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.791010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:57.797389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:57.819436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.820235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.821013 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.822004 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:57.822478 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:57.822966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:57.841550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:57.864816 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-477ae2a6-157a-40c1-8152-734c9030bbd2 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 200 len: 1432 microversion: 2.1 time: 0.340802 Nov 02 12:43:57.876961 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 793/1589] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:57 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 1432 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:58.019963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.021222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.021832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.022454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lazy-loading 'fault' on Instance uuid 8482cecf-ebd5-416c-8a38-d5e056f88bbf {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:58.205836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.212561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.215331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '346db825477f4cfca59dfa9ac8ab0455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9a8c1c922b4a9eae99d190d10ba85e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:58.216776 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e2be1601-e5f6-47ce-94f1-bf6fe4ae2a90 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 200 len: 1367 microversion: 2.57 time: 0.433604 Nov 02 12:43:58.220392 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 797/1590] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:57 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:43:58.225187 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66eec88-8a14-4f36-b486-84c06a042a69", "name": "network-vif-deleted", "tag": "ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:58.277816 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.278918 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.279543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.309410 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.310066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.327136 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.328174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.328702 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.329462 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.329931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.330367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.608177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:58.619034 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] Creating event network-vif-deleted:ac83a18f-f9e2-4583-bf1c-f2e8c12ac6be for instance d66eec88-8a14-4f36-b486-84c06a042a69 on n-h2-857339-6 Nov 02 12:43:58.626300 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-5089277f-7868-44dd-b8eb-d31954bd473e req-eda14123-ea8b-4c47-8f7a-085585d24538 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.420638 Nov 02 12:43:58.627684 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 794/1591] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:58.894214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:58.895307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:58.910473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.910975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.911583 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.912312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.912810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.913238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.983550 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:58.984044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:58.984501 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:58.993913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid d66eec88-8a14-4f36-b486-84c06a042a69 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:59.125720 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.142545 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4523fae3-0775-493a-895b-cfce8ea4963f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1474 microversion: 2.1 time: 0.839066 Nov 02 12:43:59.145928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:59.154786 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e40774cc-8af3-42ec-a3e8-0d91e97757bf tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 200 len: 1308 microversion: 2.1 time: 0.265870 Nov 02 12:43:59.172633 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 795/1592] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:58 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:59.173099 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 798/1593] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:58 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1474 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:59.251563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:59.252199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] [instance: 8482cecf-ebd5-416c-8a38-d5e056f88bbf] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:59.268323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.268954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.269464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.270424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:59.270962 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:59.271785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:59.314329 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] HTTP exception thrown: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Request method failure captured: Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf HTTP/1.1 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmXWB1H2EIRU9oYNYepEbj-RdOv7FM-rdaDB7ZSY9LQWA5PH1jc2YPeEo9VBXR3AU-eYLJpgbJ_kkvwh9R0xpTJ4ouCXIzEaXezDA6JDE-uIrjjJxUNr9tRqUZAFlrp8SJRrlZo09Wi0G-9A0JIMe4BUT4C9TByKoK3Wm4XMNGgZpFM Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.57 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 7a9a8c1c922b4a9eae99d190d10ba85e Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerShowV257Test-1333429206 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7a9a8c1c922b4a9eae99d190d10ba85e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a9a8c1c922b4a9eae99d190d10ba85e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7a9a8c1c922b4a9eae99d190d10ba85e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7a9a8c1c922b4a9eae99d190d10ba85e"}]}] Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerShowV257Test-1333429206 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 7a9a8c1c922b4a9eae99d190d10ba85e Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerShowV257Test-1333429206 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerShowV257Test-1333429206-project Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 346db825477f4cfca59dfa9ac8ab0455 Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerShowV257Test-1333429206-project Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '8482cecf-ebd5-416c-8a38-d5e056f88bbf'} Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:59.323063 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] Returning 404 to user: Instance 8482cecf-ebd5-416c-8a38-d5e056f88bbf could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8b066a5b-bdeb-4bbf-84e4-51156e985d96 tempest-ServerShowV257Test-1333429206 tempest-ServerShowV257Test-1333429206-project] 10.222.0.64 "GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf" status: 404 len: 111 microversion: 2.57 time: 0.073452 Nov 02 12:43:59.326765 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 796/1594] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:43:59 2022] GET /compute/v2.1/servers/8482cecf-ebd5-416c-8a38-d5e056f88bbf => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:44:00.185617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.186965 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d66eec88-8a14-4f36-b486-84c06a042a69] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.190284 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:00.206994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.207776 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.210213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.210926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.214758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.214758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.214758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.214758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.249464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.254928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.255466 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.259358 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. Nov 02 12:44:00.264709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.267667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.268271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 HTTP/1.1 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'd66eec88-8a14-4f36-b486-84c06a042a69'} Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:00.274763 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. Nov 02 12:44:00.279054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:00.281866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance d66eec88-8a14-4f36-b486-84c06a042a69 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:00.297302 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0f5515c2-4f50-4817-b71c-bd351d6b34c1 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69" status: 404 len: 111 microversion: 2.1 time: 0.115912 Nov 02 12:44:00.300315 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 799/1595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/d66eec88-8a14-4f36-b486-84c06a042a69 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:00.313213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:00.314087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:00.333341 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.333837 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.334278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.334994 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.335451 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.335880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.801118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:00.817470 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2887b1a7-2c6d-40f5-b02f-657ee63530be tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1432 microversion: 2.1 time: 0.615257 Nov 02 12:44:00.818080 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 797/1596] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1432 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:00.833609 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3918a345-1137-499b-a19a-da0d58f91a74", "name": "network-vif-deleted", "tag": "be6cb95f-365e-4c40-be18-d4841fe5acf9"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:00.863135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:00.866895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:00.867646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:00.897226 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] Creating event network-vif-deleted:be6cb95f-365e-4c40-be18-d4841fe5acf9 for instance 3918a345-1137-499b-a19a-da0d58f91a74 on n-h1-857339-6 Nov 02 12:44:00.917232 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-65447735-632b-422f-b061-81794fd19c61 req-def5aec1-7cfb-4794-a7ff-d2a725d7b2b5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093429 Nov 02 12:44:00.918335 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 798/1597] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:01.295044 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:01.320127 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cadacae4-2752-455c-b144-e4333a27aeb6 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1430 microversion: 2.1 time: 1.016129 Nov 02 12:44:01.321843 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 800/1598] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:00 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1430 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:01.662049 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e067965c-2afe-4b75-ace8-7b2ffba7b978", "name": "network-vif-deleted", "tag": "5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:01.688793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.689578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.690814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.718154 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] Creating event network-vif-deleted:5cf8ae4c-d45e-4861-a0f6-175ba7aedf0e for instance e067965c-2afe-4b75-ace8-7b2ffba7b978 on n-h1-857339-6 Nov 02 12:44:01.730606 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-ef5631cb-e484-4c4e-a710-476522d757a1 req-78bcf25d-e5e3-4300-89d4-5df299321dba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073788 Nov 02 12:44:01.731336 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 799/1599] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:01.848475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:01.849205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:01.870468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.870972 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.871474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.872205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.891132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.893011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.991207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:01.991649 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:01.992088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:01.992770 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lazy-loading 'fault' on Instance uuid 3918a345-1137-499b-a19a-da0d58f91a74 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:02.217465 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:02.230177 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d6a194f-5309-4f10-9b48-600d8c528358 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 200 len: 1308 microversion: 2.1 time: 0.386757 Nov 02 12:44:02.237166 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 801/1600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:01 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 1308 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:02.348146 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:02.354285 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:02.370268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:02.371610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:02.372101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:02.372853 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:02.378761 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:02.380103 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:02.437904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:02.438736 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:02.439457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:02.440085 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid e067965c-2afe-4b75-ace8-7b2ffba7b978 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:02.502371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:02.511277 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b887e202-b3ef-49d8-b332-d4764464a648 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1308 microversion: 2.1 time: 0.167418 Nov 02 12:44:02.516579 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 800/1601] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:02 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:03.269446 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:03.281674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 3918a345-1137-499b-a19a-da0d58f91a74] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:03.309641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.316741 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.317890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.319216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.320041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.324817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.364078 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] HTTP exception thrown: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Request method failure captured: Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 HTTP/1.1 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmU4W8pTq3bVS7f9gOLf961w6CYd2KzvB-9v_clgRl9-_emT77jrnHdveLRpwb1-wTHWwKF3s7hgHdOIqZ5IgRYRus39ubys62Ccoph4R0C5B-4PP_9-hBBVcdq7xn-zACUzoKkZ7m7rxsbfcm4x-WDa6uCat0FE2CyNAmg5l5_34EM Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: c0a42b724065423cb31303f3f9b55f36 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c0a42b724065423cb31303f3f9b55f36", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c0a42b724065423cb31303f3f9b55f36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c0a42b724065423cb31303f3f9b55f36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c0a42b724065423cb31303f3f9b55f36"}]}] Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: c0a42b724065423cb31303f3f9b55f36 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ListImageFiltersTestJSON-1820386669-project Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d03db5013be642b88ea298fba0d87f20 Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ListImageFiltersTestJSON-1820386669-project Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '3918a345-1137-499b-a19a-da0d58f91a74'} Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:03.368657 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. Nov 02 12:44:03.376842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:03.378469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Returning 404 to user: Instance 3918a345-1137-499b-a19a-da0d58f91a74 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:03.380211 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-58905368-a5c3-4873-bcd2-797887b4fdb9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74" status: 404 len: 111 microversion: 2.1 time: 0.120654 Nov 02 12:44:03.385719 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 802/1602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:03 2022] GET /compute/v2.1/servers/3918a345-1137-499b-a19a-da0d58f91a74 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:03.395398 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:03.408549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:03.415369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.415928 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.416579 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.417314 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.417852 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.418358 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.472654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:44:03.538518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:03.539370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:03.549102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.550484 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.551093 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.552031 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.552931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.553521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.614180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:03.615668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:03.616518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:03.616866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid e067965c-2afe-4b75-ace8-7b2ffba7b978 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:04.177174 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.190636 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f89b07e5-962a-4e04-b100-960d0f691869 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 200 len: 1308 microversion: 2.1 time: 0.653583 Nov 02 12:44:04.191298 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 803/1603] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:03 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 1308 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:04.325504 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d9814acb-d950-4e90-98f6-7f0ab76c644b tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 204 len: 0 microversion: 2.1 time: 0.938185 Nov 02 12:44:04.326176 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 801/1604] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:03 2022] DELETE /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 0 bytes in 940 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:04.335570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:04.338416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:04.350844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.351790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.352636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.356170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:04.357032 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:04.358385 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:04.856005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:04.864725 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6828befa-53bd-4c33-83bf-bc3c0a10e5f7 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1473 microversion: 2.1 time: 0.534258 Nov 02 12:44:04.868013 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 804/1605] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:04 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1473 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:05.226319 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.229408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: e067965c-2afe-4b75-ace8-7b2ffba7b978] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.243936 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.245688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.247153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.250171 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.251414 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.252860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.293618 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 HTTP/1.1 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'e067965c-2afe-4b75-ace8-7b2ffba7b978'} Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:05.302461 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. Nov 02 12:44:05.306502 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:05.309826 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance e067965c-2afe-4b75-ace8-7b2ffba7b978 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:05.313164 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9819e229-7b4e-477e-a3aa-e33d70984d59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978" status: 404 len: 111 microversion: 2.1 time: 0.090419 Nov 02 12:44:05.315316 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 802/1606] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/e067965c-2afe-4b75-ace8-7b2ffba7b978 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:05.326005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7ef5a1dc-299a-47cf-ae11-f8d60d719832 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.552777 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7ef5a1dc-299a-47cf-ae11-f8d60d719832 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/8e720467-24a9-47fe-8368-506b0d2a7221" status: 204 len: 0 microversion: 2.1 time: 0.232687 Nov 02 12:44:05.554774 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 805/1607] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:44:05 2022] DELETE /compute/v2.1/os-server-groups/8e720467-24a9-47fe-8368-506b0d2a7221 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:05.581215 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.581977 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.599371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.600048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.600585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.613534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.616995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.616995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.681520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:44:05.892064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:05.893358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:05.924437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.925709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.927768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:05.929836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:05.931047 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:05.940692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:06.190273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:06.194354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:06.202696 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ef9ce974-bead-4dc1-b0fb-27be69ce62c9 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1473 microversion: 2.1 time: 0.314954 Nov 02 12:44:06.204923 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 806/1608] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:05 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:06.410019 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8425a5f9-2063-4ec0-aaba-a84112d86d24 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 204 len: 0 microversion: 2.1 time: 0.833208 Nov 02 12:44:06.416600 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 803/1609] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:05 2022] DELETE /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 0 bytes in 836 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:06.424370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:06.425166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:06.434812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:06.435608 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:06.439954 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:06.444623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:06.445436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:06.445907 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:06.533743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:44:07.118059 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0b2aaa51-b83a-49cf-95c0-33b4c18140ac tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 204 len: 0 microversion: 2.1 time: 0.700126 Nov 02 12:44:07.118960 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 807/1610] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:06 2022] DELETE /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:44:07.128938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:07.129663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:07.143108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:07.143813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:07.144068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.148909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:07.153080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:07.154736 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.255719 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:07.256521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:07.266408 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:07.270579 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:07.271278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.273588 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:07.274260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:07.274858 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.555849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:07.574861 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-572184b1-75b6-4272-9561-3a3abe121dbe tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1431 microversion: 2.1 time: 0.323832 Nov 02 12:44:07.581952 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 808/1611] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:07 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1431 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:07.664561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56f150cf-3b5c-4ffe-9783-619b9e1dd435", "name": "network-vif-deleted", "tag": "f2839789-4a72-426e-888c-7dd2672362a4"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:07.686926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:07.687913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:07.688634 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:07.734452 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:07.750175 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] Creating event network-vif-deleted:f2839789-4a72-426e-888c-7dd2672362a4 for instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 on n-h1-857339-6 Nov 02 12:44:07.764272 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-cd7fe24a-f9d5-475e-b117-962fd5df0e1b req-ca8fa086-21bf-4edd-b020-88154fa6e5a7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104215 Nov 02 12:44:07.768762 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 809/1612] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:07.793081 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-995eda3c-2af6-4177-a82b-361bbb75946d tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1474 microversion: 2.1 time: 0.669598 Nov 02 12:44:07.802759 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 804/1613] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:07 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1474 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:08.608789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:08.610474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:08.643368 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:08.644067 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:08.645005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:08.645770 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:08.645888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:08.646272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:08.821003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:08.821722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:08.842544 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:08.844470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:08.845828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:08.846867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:08.874310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:08.884507 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:08.887086 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5ca1c3b5-364d-41ff-8f01-0f577a7a5423 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1431 microversion: 2.1 time: 0.284534 Nov 02 12:44:08.887241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:08.890605 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 810/1614] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:08 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1431 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:09.449413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:09.458299 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-677a05f5-1939-4eff-b9de-1468ef1f2570 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1474 microversion: 2.1 time: 0.642624 Nov 02 12:44:09.466311 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 805/1615] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:08 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1474 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:09.771209 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03b43bf-3491-4c06-8be8-6f70f679d53f", "name": "network-vif-unplugged", "status": "completed", "tag": "e525a055-f6de-4e9a-b9cb-07d71ab395a1"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:09.793612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.794565 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.795899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:09.815621 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] Creating event network-vif-unplugged:e525a055-f6de-4e9a-b9cb-07d71ab395a1 for instance d03b43bf-3491-4c06-8be8-6f70f679d53f on n-h1-857339-6 Nov 02 12:44:09.821916 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-12732ca9-f61d-44ae-82af-8bb5b8b05795 req-56e895ce-bb33-42eb-ba9a-40e20b462d8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055877 Nov 02 12:44:09.824475 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 811/1616] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:09.921527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:09.924938 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:09.955252 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.957574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.959016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:09.962939 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:09.964125 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:09.964810 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.043640 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.044324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.045046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.047267 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lazy-loading 'fault' on Instance uuid 56f150cf-3b5c-4ffe-9783-619b9e1dd435 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:10.494847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:10.495574 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:10.507069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.507564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.508010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.524843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd03db5013be642b88ea298fba0d87f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a42b724065423cb31303f3f9b55f36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:10.533066 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ff16092d-342d-45ba-a712-f4a496e65a6f tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 200 len: 1307 microversion: 2.1 time: 0.626889 Nov 02 12:44:10.536248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:10.537066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:10.543028 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:10.549033 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 806/1617] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:09 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 1307 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:11.216805 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04941205-20b8-4bc0-ab59-e14866c3f331", "name": "network-vif-deleted", "tag": "8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:11.226813 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:11.235237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.236389 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bb4b3873-5511-4a17-b80a-a525689e8d10 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1474 microversion: 2.1 time: 0.746439 Nov 02 12:44:11.237746 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 812/1618] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:10 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1474 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:11.238637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.239104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.263386 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] Creating event network-vif-deleted:8ae315fc-3a5b-4c1f-8b15-7ceb2678bd31 for instance 04941205-20b8-4bc0-ab59-e14866c3f331 on n-h1-857339-6 Nov 02 12:44:11.273987 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-aba94d18-e2ee-46d7-9e04-d06b5b32b0eb req-284d8a7d-937f-4d3b-908c-9454b8a9efe7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061272 Nov 02 12:44:11.276321 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 807/1619] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:11.572817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:11.573453 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] [instance: 56f150cf-3b5c-4ffe-9783-619b9e1dd435] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:11.615749 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.617774 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.624983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.632290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:11.636245 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:11.638098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:11.730203 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] HTTP exception thrown: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Request method failure captured: Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 HTTP/1.1 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmU4W8pTq3bVS7f9gOLf961w6CYd2KzvB-9v_clgRl9-_emT77jrnHdveLRpwb1-wTHWwKF3s7hgHdOIqZ5IgRYRus39ubys62Ccoph4R0C5B-4PP_9-hBBVcdq7xn-zACUzoKkZ7m7rxsbfcm4x-WDa6uCat0FE2CyNAmg5l5_34EM Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: c0a42b724065423cb31303f3f9b55f36 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c0a42b724065423cb31303f3f9b55f36", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c0a42b724065423cb31303f3f9b55f36"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c0a42b724065423cb31303f3f9b55f36"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c0a42b724065423cb31303f3f9b55f36"}]}] Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: c0a42b724065423cb31303f3f9b55f36 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1820386669 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ListImageFiltersTestJSON-1820386669-project Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: d03db5013be642b88ea298fba0d87f20 Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ListImageFiltersTestJSON-1820386669-project Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '56f150cf-3b5c-4ffe-9783-619b9e1dd435'} Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:11.741490 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. Nov 02 12:44:11.746374 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:11.753760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Returning 404 to user: Instance 56f150cf-3b5c-4ffe-9783-619b9e1dd435 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:11.757662 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d9d45547-a02b-40ef-afe9-c1d2d9768f7d tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435" status: 404 len: 111 microversion: 2.1 time: 0.189173 Nov 02 12:44:11.777299 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 813/1620] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] GET /compute/v2.1/servers/56f150cf-3b5c-4ffe-9783-619b9e1dd435 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:11.786479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-78a852dc-536c-4cdb-856a-d57c78013fbd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5cce4040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:12.269700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:12.270966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:12.304237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.305066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.305709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.306845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.307549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.308360 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.587585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:12.600851 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-584c6866-aaf1-4451-80ad-7dab9c0b4373 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1432 microversion: 2.1 time: 0.336964 Nov 02 12:44:12.602340 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 814/1621] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:12 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1432 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:12.607890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03b43bf-3491-4c06-8be8-6f70f679d53f", "name": "network-vif-deleted", "tag": "e525a055-f6de-4e9a-b9cb-07d71ab395a1"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:12.625675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:12.625675 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:12.626135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:12.648524 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] Creating event network-vif-deleted:e525a055-f6de-4e9a-b9cb-07d71ab395a1 for instance d03b43bf-3491-4c06-8be8-6f70f679d53f on n-h1-857339-6 Nov 02 12:44:12.658789 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-6815ac7b-0e97-4b3e-9c9f-24681f7ec5f1 req-85f21d20-3a4e-445e-a40c-0568ecc46232 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052561 Nov 02 12:44:12.660318 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 815/1622] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:13.424149 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-78a852dc-536c-4cdb-856a-d57c78013fbd tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd" status: 204 len: 0 microversion: 2.1 time: 1.641098 Nov 02 12:44:13.424661 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 808/1623] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:11 2022] DELETE /compute/v2.1/images/dd8080db-b326-4ba3-a041-9a04c028babd => generated 0 bytes in 1643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:13.435439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-332f319e-5913-4f65-b7a5-32e9d4ea5305 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c5fca60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:13.627990 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:13.628912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:13.636749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:13.637630 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:13.638326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:13.639288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:13.639980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:13.640666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:13.666478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:13.693329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:13.694182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:13.695051 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:13.695711 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid d03b43bf-3491-4c06-8be8-6f70f679d53f {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:14.011978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:14.025864 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bb32c994-5889-49f5-af1c-1a133bd24d8c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 200 len: 1309 microversion: 2.1 time: 0.401494 Nov 02 12:44:14.038419 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 809/1624] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:13 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:14.696628 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-332f319e-5913-4f65-b7a5-32e9d4ea5305 tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925" status: 204 len: 0 microversion: 2.1 time: 1.267456 Nov 02 12:44:14.699678 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 816/1625] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:13 2022] DELETE /compute/v2.1/images/d4d05561-f39d-4fbb-9238-323a7185d925 => generated 0 bytes in 1271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:44:14.707610 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9eda7f57-07f2-4289-bee1-3ab3c9dd2dcb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] Calling method '.version_select at 0x7eff5c27a700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:15.523598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1430262854", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:15.638902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] validate_networks() for [('09004079-0286-4a13-b6d1-fc8bb03f6cab', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:16.279673 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9eda7f57-07f2-4289-bee1-3ab3c9dd2dcb tempest-ListImageFiltersTestJSON-1820386669 tempest-ListImageFiltersTestJSON-1820386669-project] 10.222.0.64 "DELETE /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180" status: 204 len: 0 microversion: 2.1 time: 1.575796 Nov 02 12:44:16.280450 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 810/1626] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:14 2022] DELETE /compute/v2.1/images/d71c301e-96ca-430b-a6ce-135c9602e180 => generated 0 bytes in 1577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:16.285366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:16.285995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: d03b43bf-3491-4c06-8be8-6f70f679d53f] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:16.304094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.304647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.305088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.305812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.306322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.307279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.341987 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f HTTP/1.1 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'd03b43bf-3491-4c06-8be8-6f70f679d53f'} Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.343945 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. Nov 02 12:44:16.348112 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.349716 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance d03b43bf-3491-4c06-8be8-6f70f679d53f could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:16.350882 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb6ee865-8739-46c8-922d-ee84ef2309e3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f" status: 404 len: 111 microversion: 2.1 time: 0.069492 Nov 02 12:44:16.360318 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 811/1627] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:16 2022] GET /compute/v2.1/servers/d03b43bf-3491-4c06-8be8-6f70f679d53f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:16.369779 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:16.370410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 04941205-20b8-4bc0-ab59-e14866c3f331] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:16.384787 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.385297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.385738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.386474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.387027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.387451 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.405362 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 HTTP/1.1 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '04941205-20b8-4bc0-ab59-e14866c3f331'} Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.407211 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. Nov 02 12:44:16.410464 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.412352 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance 04941205-20b8-4bc0-ab59-e14866c3f331 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:16.413521 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-88f64371-4a9c-41ed-98be-e8d6d2175a52 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331" status: 404 len: 111 microversion: 2.1 time: 0.048473 Nov 02 12:44:16.414979 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 812/1628] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:16 2022] GET /compute/v2.1/servers/04941205-20b8-4bc0-ab59-e14866c3f331 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:44:16.441655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d9671892-d6b9-4e99-92d1-5fc31f14d35c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:16.597445 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3) Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] Request method failure captured: Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 247 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmYegPeGYxzDhEjf_nVpWTypogXu5aRrn1m-JRbVERQgpb81pYxCC4ReqnMVMqinhn00P3PPBYfoff5MqbXnXWbLJJklUcFi2CtfxRBNne9ZgnIadL9qQdaKuKHKpPyzHEpVlJw1tNpPfH_wZQirvzjqg9117ZeGbx6BhweER4dt1Uw Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 12c9018d300642ea8827af97192c4104 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2086648767 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_12c9018d300642ea8827af97192c4104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/12c9018d300642ea8827af97192c4104"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/12c9018d300642ea8827af97192c4104"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/12c9018d300642ea8827af97192c4104"}]}] Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2086648767 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 12c9018d300642ea8827af97192c4104 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2086648767 Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerRescueTestJSONUnderV235-2086648767-project Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 4893fb8aad454ab29cff4cc79cdfbfbc Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2086648767-project Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1430262854", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "Y0_Rnv8eG%vtnF0", "networks": [{"uuid": "09004079-0286-4a13-b6d1-fc8bb03f6cab"}]}} Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:16.600815 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSONUnderV235-server-1430262854', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'Y0_Rnv8eG%vtnF0', 'networks': [{'uuid': '09004079-0286-4a13-b6d1-fc8bb03f6cab'}]}}} Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:16.604632 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-88a69212-a0a0-4ea3-84dc-d3f2ec5083a3) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1d327f03-c0ce-429d-981a-cce867fa3ea7 tempest-ServerRescueTestJSONUnderV235-2086648767 tempest-ServerRescueTestJSONUnderV235-2086648767-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.746378 Nov 02 12:44:16.613291 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 817/1629] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1748 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:44:16.644728 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d9671892-d6b9-4e99-92d1-5fc31f14d35c tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/7921c2e9-6367-409a-bc86-1be87e9441ad" status: 204 len: 0 microversion: 2.1 time: 0.222341 Nov 02 12:44:16.648645 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 813/1630] 10.222.0.64 () {58 vars in 1266 bytes} [Wed Nov 2 12:44:16 2022] DELETE /compute/v2.1/os-server-groups/7921c2e9-6367-409a-bc86-1be87e9441ad => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:16.656879 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:16.660399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:16.674470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.674985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.675435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.676164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:16.676657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:16.677093 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:16.731384 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:44:17.312233 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d29d32ac-1875-47f1-a3a5-76559a359f63 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "DELETE /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 204 len: 0 microversion: 2.1 time: 0.659158 Nov 02 12:44:17.319053 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 818/1631] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 12:44:16 2022] DELETE /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:44:17.328127 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:17.329559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:17.348553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.349384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.350478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:17.351225 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:17.351693 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:17.354709 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:18.209825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:18.223037 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-854fb607-f05e-4f31-8954-20f42d2eed59 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1473 microversion: 2.1 time: 0.899119 Nov 02 12:44:18.225682 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 814/1632] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:17 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1473 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:19.257490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:19.260839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:19.296536 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.300912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.304283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.310684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:19.312247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:19.313297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:19.756228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:19.765102 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b738404e-a022-4b02-82c4-588cc4bcb055 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1473 microversion: 2.1 time: 0.516603 Nov 02 12:44:19.777208 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 819/1633] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:19 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1473 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:20.795704 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:20.796618 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:20.810642 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:20.811179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:20.812357 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:20.812794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:20.813422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:20.815525 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:21.324405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:21.339938 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b8fbaa17-1786-4be2-85bd-496ef5282dad tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1431 microversion: 2.1 time: 0.552135 Nov 02 12:44:21.345883 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 815/1634] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:20 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1431 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:22.162199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48de1b1f-9d7e-41bf-b1e6-023d17cecc0e", "name": "network-vif-deleted", "tag": "3d81e47f-bfd3-4fb1-86b4-cc02113a5157"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:22.207688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:22.213344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:22.214977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.273148 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] Creating event network-vif-deleted:3d81e47f-bfd3-4fb1-86b4-cc02113a5157 for instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e on n-h2-857339-6 Nov 02 12:44:22.314557 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-2bd2c350-1d77-49e8-806a-049cbff75fe6 req-0cd33249-ce36-427e-a6e1-708c7f91773e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157340 Nov 02 12:44:22.319599 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 820/1635] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 12:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:44:22.385686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:22.385686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:22.399386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:22.406055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:22.409739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.415201 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:22.416312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:22.421715 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:22.861095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:22.882264 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ff4303bf-33c1-4f0c-9518-c71525def934 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1302 microversion: 2.1 time: 0.507907 Nov 02 12:44:22.886320 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 816/1636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:22 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1302 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:44:23.825524 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ec61a1c-388e-4dfa-bf81-4c36b2ca3dcd tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5c7af8b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0z2dJIltfReWg6I5k7cmf5WXDgxi7h3Evxm+yibjiA/YaVDbIonxVM+NhN6AY5d+/kxGrIXbuE7IXURDN5yrbuS8eTMH6NyZCW+JhwKqbFMncMStj714aR3k/M6qGjVw=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ec61a1c-388e-4dfa-bf81-4c36b2ca3dcd tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 257 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0z2dJIltfReWg6I5k7cmf5WXDgxi7h3Evxm+yibjiA/YaVDbIonxVM+NhN6AY5d+/kxGrIXbuE7IXURDN5yrbuS8eTMH6NyZCW+JhwKqbFMncMStj714aR3k/M6qGjVw=="}} Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0z2dJIltfReWg6I5k7cmf5WXDgxi7h3Evxm+yibjiA/YaVDbIonxVM+NhN6AY5d+/kxGrIXbuE7IXURDN5yrbuS8eTMH6NyZCW+JhwKqbFMncMStj714aR3k/M6qGjVw=='}}} Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = func(instance) Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'minLength': 1, Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'type': 'string'} Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Nov 02 12:44:23.843055 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:23.856461 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1ec61a1c-388e-4dfa-bf81-4c36b2ca3dcd tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:23.858387 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1ec61a1c-388e-4dfa-bf81-4c36b2ca3dcd tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.381757 Nov 02 12:44:23.863618 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 821/1637] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:23 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 390 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:44:23.870675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5cd1e940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-45017747", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:23.910262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:23.912549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:23.935294 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.935747 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.936190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:23.938883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:23.939536 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:23.940126 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:23.946023 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:23.963937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for user 276ebe7b0d1b4962a18cd74a07fe6c7c and project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:24.010730 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 2165 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-45017747", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:24.045863 n-d-857339-6 devstack@n-api.service[127766]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-45017747', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:24.048371 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.052257 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.072823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:24.072823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:24.072823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:24.073702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:24.073797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lazy-loading 'fault' on Instance uuid 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:44:24.073893 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a89786fe-2081-42be-897d-131341ad45cb tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.190012 Nov 02 12:44:24.073893 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 817/1638] 10.222.0.64 () {60 vars in 1160 bytes} [Wed Nov 2 12:44:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:24.087035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5d822c0b-7660-4c33-a1ee-c6ce8c4a6431 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5c335430>, body: {"keypair": {"name": "tempest-keypair-52978063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMreMI8YiD5zbcFVx0Z6XsB70puhlVu676ACtGsDWR5xYsLjPZZBMqAl5pd3aptA5Fb+oH6Zz6b8br92ALi471Za3IBxJxvMQwCPUDLX4idh6uUWBHESCyG25Omepwbopg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.115907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-5d822c0b-7660-4c33-a1ee-c6ce8c4a6431 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:24.121862 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-5d822c0b-7660-4c33-a1ee-c6ce8c4a6431 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for user 276ebe7b0d1b4962a18cd74a07fe6c7c and project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:24.265411 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5d822c0b-7660-4c33-a1ee-c6ce8c4a6431 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.184615 Nov 02 12:44:24.266490 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 818/1639] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:44:24.281650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5d2b1dc0>, body: {"keypair": {"name": "tempest-keypair-52978063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfw7C2UULDIcIm2AVZFomwG4sCDX/Wkd68h5rfVWxPBrsou4WTX5v2UNbRgPPBa6f3Ts8gIo+d+H8LjLQb0lWtnUZKESrQvdgSZGV/bDAb+Mn2HUK/qvuf+UvFSTSEkzA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.324380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:24.349091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for user 276ebe7b0d1b4962a18cd74a07fe6c7c and project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:24.365753 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:24.452231 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] HTTP exception thrown: Key pair 'tempest-keypair-52978063' already exists. Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 271 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "tempest-keypair-52978063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfw7C2UULDIcIm2AVZFomwG4sCDX/Wkd68h5rfVWxPBrsou4WTX5v2UNbRgPPBa6f3Ts8gIo+d+H8LjLQb0lWtnUZKESrQvdgSZGV/bDAb+Mn2HUK/qvuf+UvFSTSEkzA=="}} Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: exception: Key pair 'tempest-keypair-52978063' already exists. Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-52978063', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfw7C2UULDIcIm2AVZFomwG4sCDX/Wkd68h5rfVWxPBrsou4WTX5v2UNbRgPPBa6f3Ts8gIo+d+H8LjLQb0lWtnUZKESrQvdgSZGV/bDAb+Mn2HUK/qvuf+UvFSTSEkzA=='}}} Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '276ebe7b0d1b4962a18cd74a07fe6c7c-tempest-keypair-52978063' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 12:44:24.471423 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi kp.save(context.session) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi session.flush() Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._flush(objects) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi compat.raise_( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi flush_context.execute() Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi rec.execute(self) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self._query(query) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi conn.query(q) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result.read() Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Nov 02 12:44:24.474965 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '276ebe7b0d1b4962a18cd74a07fe6c7c-tempest-keypair-52978063' for key 'key_pairs.uniq_key_pairs0user_id0name'") Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 11, 2, 12, 44, 24, 376944), 'updated_at': None, 'name': 'tempest-keypair-52978063', 'user_id': '276ebe7b0d1b4962a18cd74a07fe6c7c', 'fingerprint': 'a3:c7:6a:81:80:21:fb:13:66:0a:a8:fe:1d:dd:9e:69', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfw7C2UULDIcIm2AVZFomwG4sCDX/Wkd68h5rfVWxPBrsou4WTX5v2UNbRgPPBa6f3Ts8gIo+d+H8LjLQb0lWtnUZKESrQvdgSZGV/bDAb+Mn2HUK/qvuf+UvFSTSEkzA==', 'type': 'ssh'}] Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keypair.create() Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._create() Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-52978063' already exists. Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Nov 02 12:44:24.481430 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-52978063' already exists. Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-52978063' already exists. Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 409 to user: Key pair 'tempest-keypair-52978063' already exists. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8065ab14-7a01-4b62-ae52-18e0fe703756 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 409 len: 103 microversion: 2.1 time: 0.211107 Nov 02 12:44:24.493412 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 819/1640] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 103 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:44:24.507092 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e147bf68-ba20-4148-8dff-ffbc21e4871b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Calling method '.version_select at 0x7eff5c4f8e50>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:24.664472 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e147bf68-ba20-4148-8dff-ffbc21e4871b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-52978063" status: 202 len: 0 microversion: 2.1 time: 0.167823 Nov 02 12:44:24.665187 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 820/1641] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Nov 2 12:44:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-52978063 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:44:24.685255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b16f8c86-50e9-4a90-a5d6-c4db078e5b96 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5c214f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdPL+IekapLp0Au/PeRgidP6KcpKq30a5uX3UHeieXTHKv1tpo8BFtcAA8lnblIrBO2TLWCtngvfvxvCHLCYNWXq5xSbeEoK6++zgn5syfuH0ITPqtxg5zBLS24OqPhAA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b16f8c86-50e9-4a90-a5d6-c4db078e5b96 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 247 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdPL+IekapLp0Au/PeRgidP6KcpKq30a5uX3UHeieXTHKv1tpo8BFtcAA8lnblIrBO2TLWCtngvfvxvCHLCYNWXq5xSbeEoK6++zgn5syfuH0ITPqtxg5zBLS24OqPhAA=="}} Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdPL+IekapLp0Au/PeRgidP6KcpKq30a5uX3UHeieXTHKv1tpo8BFtcAA8lnblIrBO2TLWCtngvfvxvCHLCYNWXq5xSbeEoK6++zgn5syfuH0ITPqtxg5zBLS24OqPhAA=='}}} Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi '' Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:44:24.698454 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Nov 02 12:44:24.702767 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.707315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b16f8c86-50e9-4a90-a5d6-c4db078e5b96 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:24.709439 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b16f8c86-50e9-4a90-a5d6-c4db078e5b96 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.031720 Nov 02 12:44:24.717613 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 821/1642] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:44:24.734975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5cee38b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-368632031", "public_key": " "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.819059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:24.846195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for user 276ebe7b0d1b4962a18cd74a07fe6c7c and project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:24.909300 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 94 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-368632031", "public_key": " "}} Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-368632031', 'public_key': ' '}}} Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.911341 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:24.915793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.922543 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:24.924475 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a2537a38-5dc1-4681-bb4e-60deb5db42e8 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.192760 Nov 02 12:44:24.927632 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 822/1643] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:44:24.951374 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-25e878d0-362a-4c24-844c-c6e59d3059a7 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5c4ad820>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmNAi7h/G8P05lb0qeOJ9pA+xNmVQ3LdQItZjxigeKFOoDUCxZT6fLkOc6lyTQx5nsmroCamLrRSWraNBUoov+Y6aN7mR0RwehGqUUD7tZbVm5Nw8Y8oaHgOGFYz4bqWA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-25e878d0-362a-4c24-844c-c6e59d3059a7 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 507 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmNAi7h/G8P05lb0qeOJ9pA+xNmVQ3LdQItZjxigeKFOoDUCxZT6fLkOc6lyTQx5nsmroCamLrRSWraNBUoov+Y6aN7mR0RwehGqUUD7tZbVm5Nw8Y8oaHgOGFYz4bqWA=="}} Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmNAi7h/G8P05lb0qeOJ9pA+xNmVQ3LdQItZjxigeKFOoDUCxZT6fLkOc6lyTQx5nsmroCamLrRSWraNBUoov+Y6aN7mR0RwehGqUUD7tZbVm5Nw8Y8oaHgOGFYz4bqWA=='}}} Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance['keypair']: Nov 02 12:44:24.955820 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Nov 02 12:44:24.961903 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:24.971315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-25e878d0-362a-4c24-844c-c6e59d3059a7 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:24.973213 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f1602f439f64597ae371c084e7faed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd844366c7343be97d0911ff5c05ba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:44:24.973899 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-25e878d0-362a-4c24-844c-c6e59d3059a7 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.027441 Nov 02 12:44:24.976412 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 823/1644] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:44:24.984286 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9bc24b4c-7e52-44a6-a8b0-1da01f6bd783 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 200 len: 1307 microversion: 2.1 time: 1.077756 Nov 02 12:44:24.985955 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 822/1645] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:23 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 1307 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:44:24.994631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Action: 'create', calling method: .version_select at 0x7eff5c274b80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-67045364", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:25.043585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:44:25.070181 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Getting quotas for user 276ebe7b0d1b4962a18cd74a07fe6c7c and project 3cba33c0c76d4baba02f19f515721a27. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:44:25.128865 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 116 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-67045364", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: exception: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-67045364', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Nov 02 12:44:25.130855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create(req, body) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-14122ada-6c66-423e-a86f-292b21679ba4 tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.145799 Nov 02 12:44:25.151219 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 824/1646] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:44:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Nov 02 12:44:25.161589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b4fd607-8212-40b1-b764-c347d49dfa6b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Calling method '.version_select at 0x7eff5c673d30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:25.195568 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7b4fd607-8212-40b1-b764-c347d49dfa6b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b4fd607-8212-40b1-b764-c347d49dfa6b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Request method failure captured: Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-791411940 HTTP/1.1 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmYnjTCxz_ItxwneCYW-2KHHlpNKXFhlx4buejpuNrzOvfMRE9Ver7kN5HGdXo_Mr5mlyVdl9Kgz7omyaF3ra8FT1OMEaMYW8mUnYAdCfCExnm8-XBmAc1k21iF-5qmGiYYFhK54POIrTZQAndOQHzN1fJLzWKHU0Kd-ua1ep_OTfPg Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3cba33c0c76d4baba02f19f515721a27", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3cba33c0c76d4baba02f19f515721a27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3cba33c0c76d4baba02f19f515721a27"}]}] Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 3cba33c0c76d4baba02f19f515721a27 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1678889890 Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1678889890-project Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: exception: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'tempest-keypair-non-existent-791411940'} Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.force_reraise() Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise self.value Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.206331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._delete(req, id) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b4fd607-8212-40b1-b764-c347d49dfa6b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] Returning 404 to user: Keypair tempest-keypair-non-existent-791411940 not found for user 276ebe7b0d1b4962a18cd74a07fe6c7c {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7b4fd607-8212-40b1-b764-c347d49dfa6b tempest-KeyPairsNegativeTestJSON-1678889890 tempest-KeyPairsNegativeTestJSON-1678889890-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-791411940" status: 404 len: 144 microversion: 2.1 time: 0.064336 Nov 02 12:44:25.224162 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 823/1647] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 12:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-791411940 => generated 144 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:44:26.041605 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:44:26.043689 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] [instance: 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:44:26.052688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:26.064279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:26.066502 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:26.067743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:44:26.068476 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:44:26.069202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:44:26.132972 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] HTTP exception thrown: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Request method failure captured: Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e HTTP/1.1 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmTZiCk6K2_Qshn5Vdssd8LpQIfl73oYT3zFZpDGGpsEXaYj0AhjeKO76qC41P1ks7_vawxn9oEFt1WQCXYx6jgAWnAxH6BtFuHpqPB0TT9-_YKOaGv28Nn4hL6zUyXWBeOhxgubwV4HuQ1YZNYMKmc-2ReN0nONCjHDbqgrYeLKRJ4 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cdd844366c7343be97d0911ff5c05ba4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cdd844366c7343be97d0911ff5c05ba4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cdd844366c7343be97d0911ff5c05ba4"}]}] Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: cdd844366c7343be97d0911ff5c05ba4 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1923437290 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 7f1602f439f64597ae371c084e7faed0 Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersOnMultiNodesTest-1923437290-project Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '48de1b1f-9d7e-41bf-b1e6-023d17cecc0e'} Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:26.135894 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. Nov 02 12:44:26.139677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:26.143587 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] Returning 404 to user: Instance 48de1b1f-9d7e-41bf-b1e6-023d17cecc0e could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:26.145105 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-87fa92d7-1597-48f4-9f6a-4789c27849f3 tempest-ServersOnMultiNodesTest-1923437290 tempest-ServersOnMultiNodesTest-1923437290-project] 10.222.0.64 "GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e" status: 404 len: 111 microversion: 2.1 time: 0.107453 Nov 02 12:44:26.150301 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 825/1648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 12:44:26 2022] GET /compute/v2.1/servers/48de1b1f-9d7e-41bf-b1e6-023d17cecc0e => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:44:32.699366 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-858534943", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "378dbe2d-824b-47c3-93ef-df143eb7ac57"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:32.886829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] validate_networks() for [('378dbe2d-824b-47c3-93ef-df143eb7ac57', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e072549a-c455-45a5-be05-5abeee64c1fb) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:34.061297 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e072549a-c455-45a5-be05-5abeee64c1fb) Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:34.064876 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] Request method failure captured: Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 208 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmYvQi003UyBUeybRPBP9fx9gVPK_IS06Ht8upO5c2PtLXfwAcxcX46NPEx0XqRGVt0157CBspn-KBE5GW79YEqgylu9tPEsx-DFCiB7nFecHHKrb6X_piV-IW9bK1VWRDr_xAilUEzbEWM-tEOf4Oem2X4Z3yA9A58be38c0AaSTr4 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 609b25c5d73a4866898c08b5b37c063c Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-InstanceActionsTestJSON-245525635 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_609b25c5d73a4866898c08b5b37c063c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/609b25c5d73a4866898c08b5b37c063c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/609b25c5d73a4866898c08b5b37c063c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/609b25c5d73a4866898c08b5b37c063c"}]}] Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-InstanceActionsTestJSON-245525635 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 609b25c5d73a4866898c08b5b37c063c Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-InstanceActionsTestJSON-245525635 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-InstanceActionsTestJSON-245525635-project Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 8fc9b2638f1f4af7acb932cdfdc0d4d5 Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-InstanceActionsTestJSON-245525635-project Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-InstanceActionsTestJSON-server-858534943", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "378dbe2d-824b-47c3-93ef-df143eb7ac57"}]}} Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsTestJSON-server-858534943', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '378dbe2d-824b-47c3-93ef-df143eb7ac57'}]}}} Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:34.069239 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e072549a-c455-45a5-be05-5abeee64c1fb) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:44:34.078463 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7cb2851b-bf70-466b-a7f5-f56d6169f074 tempest-InstanceActionsTestJSON-245525635 tempest-InstanceActionsTestJSON-245525635-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.131910 Nov 02 12:44:34.085292 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 824/1649] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:31 2022] POST /compute/v2.1/servers => generated 214 bytes in 2135 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:44:50.165706 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=20 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:50.167370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=30 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:44:50.880579 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1364119204", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "0085588f-09f5-4809-be57-cb5e7f5f2c05"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:44:51.336234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] validate_networks() for [('0085588f-09f5-4809-be57-cb5e7f5f2c05', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-add357fa-aff8-4ba6-8cb4-1c259f00af80) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:51.707677 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-add357fa-aff8-4ba6-8cb4-1c259f00af80) Nov 02 12:44:51.711853 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.719242 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:51.719242 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] Request method failure captured: Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 220 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYr9EWvZq2mbxJWb_BgNd6AdCVVs7ewV7x7gtSZ8Mbya1ynO4QCO9JhtRvcgKo1IUR7BJpSNHJOpkZAnsCYfGspCzuP4MDs2r5p7jH7kXOeGAQb8npGMfW2I46j5pOqh1szPKgzH5ce00mTA7bHRnRMKZb0ml1wvcixYHQNhBRhN0U Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a62ee57746e345a799a6ddab45624dc9 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1540134046 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a62ee57746e345a799a6ddab45624dc9", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a62ee57746e345a799a6ddab45624dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a62ee57746e345a799a6ddab45624dc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a62ee57746e345a799a6ddab45624dc9"}]}] Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1540134046 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a62ee57746e345a799a6ddab45624dc9 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1540134046 Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1540134046-project Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 12efbd6f761d49ceb86b035b48c47c7e Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1540134046-project Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1364119204", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "0085588f-09f5-4809-be57-cb5e7f5f2c05"}]}} Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestMultiTenantJSON-server-1364119204', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '0085588f-09f5-4809-be57-cb5e7f5f2c05'}]}}} Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:44:51.719916 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-add357fa-aff8-4ba6-8cb4-1c259f00af80) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:44:51.740837 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-00d1ba80-7b3d-49ca-916f-b9aa6ffb0a7b tempest-ServersNegativeTestMultiTenantJSON-1540134046 tempest-ServersNegativeTestMultiTenantJSON-1540134046-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.560869 Nov 02 12:44:51.749950 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 826/1650] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:44:50 2022] POST /compute/v2.1/servers => generated 214 bytes in 1562 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:06.153937 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.156029 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.437775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2001540771", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "4706b3d1-832b-41ea-96fa-f409906efd4d"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:06.572818 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] validate_networks() for [('4706b3d1-832b-41ea-96fa-f409906efd4d', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:06.699677 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:06.801606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1952607088", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:06.910760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] validate_networks() for [('4a71a857-cbbc-4f91-9823-ad7a1b98d38c', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-301702e7-eee5-4643-a0ab-eb5d476b276f) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:08.047720 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-301702e7-eee5-4643-a0ab-eb5d476b276f) Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:08.051722 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] Request method failure captured: Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 217 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmZRMVLcC2thht1pNxxPhe1sf_zt6ZcM6yvM0eQOP4ZTLI0hhv8JXTrimLJJwims_gVwW1QcxUpBLq7ln5FGTL8PynIAbwbi4Obow_bLXcqyzC24cIQvhVT1Enb2TdbBfqqLYI_aOZonxQasNBb79yF2Jnv0MHP5pKomPtZXB4VzQ8k Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 028ae84504c3470795228745c92988ae Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1179511677 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_028ae84504c3470795228745c92988ae", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/028ae84504c3470795228745c92988ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/028ae84504c3470795228745c92988ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/028ae84504c3470795228745c92988ae"}]}] Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1179511677 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 028ae84504c3470795228745c92988ae Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1179511677 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-InstanceActionsNegativeTestJSON-1179511677-project Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: e1fd343aed7f4afa811a5a04837e8bc4 Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1179511677-project Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2001540771", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "4706b3d1-832b-41ea-96fa-f409906efd4d"}]}} Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-InstanceActionsNegativeTestJSON-server-2001540771', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '4706b3d1-832b-41ea-96fa-f409906efd4d'}]}}} Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:08.053993 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-301702e7-eee5-4643-a0ab-eb5d476b276f) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:08.063820 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-59a7e9e6-b985-46b8-97b4-a95118c5a303 tempest-InstanceActionsNegativeTestJSON-1179511677 tempest-InstanceActionsNegativeTestJSON-1179511677-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.909183 Nov 02 12:45:08.066676 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 825/1651] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 1911 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-088e6699-e2f2-42f2-b111-9d975ddb77d5) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:09.057953 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-088e6699-e2f2-42f2-b111-9d975ddb77d5) Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] Request method failure captured: Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 246 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmZSlBwjImC8jgEHfq-DNabqLfSATdT0BStDpAaZeG-rTwgbNbknqALYGRv32PIHH5YjDnouU5DXsv045dpe4LTJc9aeScnXHOKamcZBvaxX7ry5AgABlSaorL_NrQPv4-pT9YiSaXrr4sxxdqdzxMKDX-JPYeV4Zb_fvFkkcWPLjOY Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 6839662ece854e21ac3002b262fdc52e Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-147916638 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6839662ece854e21ac3002b262fdc52e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6839662ece854e21ac3002b262fdc52e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6839662ece854e21ac3002b262fdc52e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6839662ece854e21ac3002b262fdc52e"}]}] Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-147916638 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 6839662ece854e21ac3002b262fdc52e Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-147916638 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerRescueNegativeTestJSON-147916638-project Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: e92466fea4504554b1bda7cea02b45a7 Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-147916638-project Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1952607088", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "L7#xT2DD+&kgsmo", "networks": [{"uuid": "4a71a857-cbbc-4f91-9823-ad7a1b98d38c"}]}} Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:09.064003 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueNegativeTestJSON-server-1952607088', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'L7#xT2DD+&kgsmo', 'networks': [{'uuid': '4a71a857-cbbc-4f91-9823-ad7a1b98d38c'}]}}} Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:09.074254 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-088e6699-e2f2-42f2-b111-9d975ddb77d5) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-252e3578-496b-4fdb-ba6d-a29182c95d0f tempest-ServerRescueNegativeTestJSON-147916638 tempest-ServerRescueNegativeTestJSON-147916638-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.368240 Nov 02 12:45:09.092743 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 827/1652] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 2369 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 12:45:10.376626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-933508929", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f02404b1-751d-4127-8dd8-cfd3a3cfbf6e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:11.124742 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] validate_networks() for [('f02404b1-751d-4127-8dd8-cfd3a3cfbf6e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c436092-2eef-4e27-afea-4a64c83c0fdb) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:11.843474 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c436092-2eef-4e27-afea-4a64c83c0fdb) Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:11.847448 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] Request method failure captured: Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 215 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmZVQcSaGxfuhfv_s7RuDPb1O6TrrP73bi1PdScoZlvvufM-FFG0JIWXL17_MkAD9REKkqurY7XliImyFoz-Bp1Q9kEm_K-vVhBtYS65yfhMULGueEWJ91HlZeB8PrHYqH2cBBzZjqhSbNfoSWYSqR_lYmmIMjCZx0NfxIXOj6WYn2o Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6fcb3622750f4d468efb3f30bd74a498 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-470650970 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6fcb3622750f4d468efb3f30bd74a498", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6fcb3622750f4d468efb3f30bd74a498"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6fcb3622750f4d468efb3f30bd74a498"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6fcb3622750f4d468efb3f30bd74a498"}]}] Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-470650970 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6fcb3622750f4d468efb3f30bd74a498 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-470650970 Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FloatingIPsAssociationTestJSON-470650970-project Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: a10dacce8dd54fdfa16778aefa38e43e Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-470650970-project Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-933508929", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f02404b1-751d-4127-8dd8-cfd3a3cfbf6e"}]}} Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-FloatingIPsAssociationTestJSON-server-933508929', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f02404b1-751d-4127-8dd8-cfd3a3cfbf6e'}]}}} Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:11.853459 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c436092-2eef-4e27-afea-4a64c83c0fdb) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:11.858352 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:11.861626 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:11.862452 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d35cf173-a8d1-4952-bbe5-cc6669f0e138 tempest-FloatingIPsAssociationTestJSON-470650970 tempest-FloatingIPsAssociationTestJSON-470650970-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.666947 Nov 02 12:45:11.870787 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 826/1653] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1682 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:17.033919 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1162120653", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "607755e4-df67-450d-8cc7-beb6925f3a1d"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:17.145530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] validate_networks() for [('607755e4-df67-450d-8cc7-beb6925f3a1d', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:18.326535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb) Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] Request method failure captured: Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 209 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmZcrcYlFzTRiwR8YPhqhTBlp4TFF9f74PBTCE1UoB6iTgInuecABLMWpJ1iv_Fk3Oo8YB5S5rd1mI24q7jDZRLJtFu5s5ofOygLduaAOLxf4QB09kT23kgn1UXIZxdqjfVTXDamaA2rDAH_Bh2GRaSafSfPhfaw9Y9is9R7ItCKjRM Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 48e7348010084007a1f39fd226ff05d9 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersNegativeTestJSON-55591510 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_48e7348010084007a1f39fd226ff05d9", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/48e7348010084007a1f39fd226ff05d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/48e7348010084007a1f39fd226ff05d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/48e7348010084007a1f39fd226ff05d9"}]}] Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersNegativeTestJSON-55591510 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 48e7348010084007a1f39fd226ff05d9 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersNegativeTestJSON-55591510 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersNegativeTestJSON-55591510-project Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6ba62c421ca94a938534b56430fddd85 Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersNegativeTestJSON-55591510-project Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1162120653", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "607755e4-df67-450d-8cc7-beb6925f3a1d"}]}} Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1162120653', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '607755e4-df67-450d-8cc7-beb6925f3a1d'}]}}} Nov 02 12:45:18.330602 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:18.334226 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a6a9d3ad-383e-4780-a53b-5785bf5f3cfb) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:18.338124 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6c4e4922-180c-409b-8b68-27d8aa34aaef tempest-ServersNegativeTestJSON-55591510 tempest-ServersNegativeTestJSON-55591510-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.649221 Nov 02 12:45:18.342725 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 828/1654] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 1660 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:38.787900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:39.426780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-812a5b1d-5043-414d-a191-5d0ead2364b0 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Action: 'create', calling method: .version_select at 0x7eff5c6949d0>, body: {"keypair": {"name": "tempest-keypair-1050655286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnoeE0zwUCG49D3ZHpqZMgAMX49wZpJ+Y2IWy7SEkjaI/K/V4AB8Z3yNVKoWwIb7ccVc0DwNcRaAGi6V8fwLMkj5VxQLm6U/PD7SgmVx1jb8rPi0EzS1Q/mcnoH1k875g=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:39.464367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-812a5b1d-5043-414d-a191-5d0ead2364b0 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Getting quotas for project a444e4c0cab7408b8e6cc8b87398f290. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:39.473076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-812a5b1d-5043-414d-a191-5d0ead2364b0 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Getting quotas for user 1dea9e27e67b4fd888fb2c4085ec5bfb and project a444e4c0cab7408b8e6cc8b87398f290. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:39.605760 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-812a5b1d-5043-414d-a191-5d0ead2364b0 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.818966 Nov 02 12:45:39.607526 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 827/1655] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:45:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:43.440282 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:44.363516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7a1abb36-5c24-4074-86cd-48be747bfdfe tempest-ComputeTenantNetworksTest-747982703 tempest-ComputeTenantNetworksTest-747982703-project] Calling method '.version_select at 0x7eff5c78d790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:44.785288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e75e47b-b58e-42bb-9887-d4d463e6bba5 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] Calling method '.version_select at 0x7eff5cbf04c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:44.847837 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7a1abb36-5c24-4074-86cd-48be747bfdfe tempest-ComputeTenantNetworksTest-747982703 tempest-ComputeTenantNetworksTest-747982703-project] 10.222.0.64 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.412945 Nov 02 12:45:44.848979 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 829/1656] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 12:45:43 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:44.917107 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e75e47b-b58e-42bb-9887-d4d463e6bba5 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.416405 Nov 02 12:45:44.919818 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 828/1657] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:45:44 2022] GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9/defaults => generated 371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:44.932575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7cfa439d-f1a6-4871-a897-dc9daaa3ec40 tempest-ComputeTenantNetworksTest-747982703 tempest-ComputeTenantNetworksTest-747982703-project] Calling method '.version_select at 0x7eff5c7af430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:44.971532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-933282697", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ee31e721-c079-4424-a359-741ec014e771"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:45.084353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] validate_networks() for [('ee31e721-c079-4424-a359-741ec014e771', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:45.149285 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7cfa439d-f1a6-4871-a897-dc9daaa3ec40 tempest-ComputeTenantNetworksTest-747982703 tempest-ComputeTenantNetworksTest-747982703-project] 10.222.0.64 "GET /compute/v2.1/os-tenant-networks/d801f38e-4ac0-43a2-9d59-f650ded55e99" status: 200 len: 139 microversion: 2.1 time: 0.226780 Nov 02 12:45:45.149969 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 829/1658] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:45:44 2022] GET /compute/v2.1/os-tenant-networks/d801f38e-4ac0-43a2-9d59-f650ded55e99 => generated 139 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:45.157169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-02908e58-8816-449c-83c1-70f5702dc9d5 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] Calling method '.version_select at 0x7eff5c712af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:45.331873 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-02908e58-8816-449c-83c1-70f5702dc9d5 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9" status: 200 len: 371 microversion: 2.1 time: 0.177191 Nov 02 12:45:45.333584 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 830/1659] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:45.412272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-47a77ab2-aba0-44b4-a60a-a9528a0673ac tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] Calling method '.version_select at 0x7eff5c1df8b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:45.602661 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-47a77ab2-aba0-44b4-a60a-a9528a0673ac tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9/defaults" status: 200 len: 371 microversion: 2.1 time: 0.251637 Nov 02 12:45:45.606241 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 831/1660] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9/defaults => generated 371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:45.623153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dba07617-6acc-4912-807e-9edfde78bc42 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] Calling method '.version_select at 0x7eff5c712c10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:45.789459 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dba07617-6acc-4912-807e-9edfde78bc42 tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9" status: 200 len: 371 microversion: 2.1 time: 0.170515 Nov 02 12:45:45.799318 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 832/1661] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9 => generated 371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:45.811280 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-423d9485-7687-45f5-8f8f-7bf6d898d1be tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] Calling method '.version_select at 0x7eff5c7908b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5b34166-7325-4522-81dc-0cec83d4c2e3) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:46.097512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5b34166-7325-4522-81dc-0cec83d4c2e3) Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] Request method failure captured: Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 212 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmZ4iSQP3L6B5Lc7NdC_K2JPmD3SsjUG8euDM2_xwYy-UQrF_BWv5GvgFWezIWr1A6uHEEAxYYkp3IiTtG7hNZclt5Li9-h_A6x9nLS2Xc5bieWfQFoKOsQXg959nUiYrPCl5PJ3ROMwAxfmo15n_a-fF7fGf_T4OBKaxuEYzhGL1vU Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8dd031c413e74d51a02e5d0661123e70 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ListServerFiltersTestJSON-491948469 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8dd031c413e74d51a02e5d0661123e70", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8dd031c413e74d51a02e5d0661123e70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8dd031c413e74d51a02e5d0661123e70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8dd031c413e74d51a02e5d0661123e70"}]}] Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ListServerFiltersTestJSON-491948469 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8dd031c413e74d51a02e5d0661123e70 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-491948469 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ListServerFiltersTestJSON-491948469-project Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b0286c0b1e1948c6af5ec7d763a72bd8 Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ListServerFiltersTestJSON-491948469-project Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-933282697", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ee31e721-c079-4424-a359-741ec014e771"}]}} Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:46.101022 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ListServerFiltersTestJSON-instance-933282697', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'ee31e721-c079-4424-a359-741ec014e771'}]}}} Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:46.107520 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b5b34166-7325-4522-81dc-0cec83d4c2e3) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6f4c523c-d4e7-4f75-b647-52c2fa499066 tempest-ListServerFiltersTestJSON-491948469 tempest-ListServerFiltersTestJSON-491948469-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.252065 Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 830/1662] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:44 2022] POST /compute/v2.1/servers => generated 214 bytes in 1254 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:46.122957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-781892544", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c33691cf-ac79-4e52-b490-b71908bf66b5"}], "security_groups": [{"name": "tempest-securitygroup--1679467450"}], "key_name": "tempest-keypair-1050655286", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:46.484161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] validate_networks() for [('c33691cf-ac79-4e52-b490-b71908bf66b5', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:46.661299 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-423d9485-7687-45f5-8f8f-7bf6d898d1be tempest-QuotasTestJSON-818313059 tempest-QuotasTestJSON-818313059-project] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9?user_id=490c2179fbc6420e8ed58d032c286793" status: 200 len: 371 microversion: 2.1 time: 0.857638 Nov 02 12:45:46.665962 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 833/1663] 10.222.0.64 () {58 vars in 1323 bytes} [Wed Nov 2 12:45:45 2022] GET /compute/v2.1/os-quota-sets/fc33ed7c067f48a2a3dda4963fbe78d9?user_id=490c2179fbc6420e8ed58d032c286793 => generated 371 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:46.684184 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-376e1a18-266d-4257-a85e-fe22254bd32a tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5d266820>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:46.803097 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-376e1a18-266d-4257-a85e-fe22254bd32a tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/bccf9243-64ee-4193-be77-04ef9bd30102" status: 200 len: 349 microversion: 2.1 time: 0.135373 Nov 02 12:45:46.812645 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 834/1664] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:45:46 2022] GET /compute/v2.1/os-volumes/bccf9243-64ee-4193-be77-04ef9bd30102 => generated 349 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:47.423016 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a) Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:47.426442 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Request method failure captured: Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 464 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmZaARvkkg7Sa_-OSMiigtvUPd7WVMezsgl2mWDvILWcX2wqLGHnlv0bTkdk-__ajedwOOB8yjz6ettpvGEUtG4uH6ZU2ND19iMQUoyjlgqNEpduCfHG1KuTB8hvGp213s_F3vK2yHSwAXBjGSWVAPZPJVp0R6_1F8xUJ29_YRcW378 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a444e4c0cab7408b8e6cc8b87398f290 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a444e4c0cab7408b8e6cc8b87398f290", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a444e4c0cab7408b8e6cc8b87398f290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a444e4c0cab7408b8e6cc8b87398f290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a444e4c0cab7408b8e6cc8b87398f290"}]}] Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a444e4c0cab7408b8e6cc8b87398f290 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesAdminNegativeTest-996690738-project Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 1dea9e27e67b4fd888fb2c4085ec5bfb Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesAdminNegativeTest-996690738-project Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-781892544", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c33691cf-ac79-4e52-b490-b71908bf66b5"}], "security_groups": [{"name": "tempest-securitygroup--1679467450"}], "key_name": "tempest-keypair-1050655286", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-781892544', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'c33691cf-ac79-4e52-b490-b71908bf66b5'}], 'security_groups': [{'name': 'tempest-securitygroup--1679467450'}], 'key_name': 'tempest-keypair-1050655286', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:47.428296 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-55bfd4dd-579c-49d2-b9d4-0eb76115c92a) Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:47.442348 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9e35e000-b3db-41a8-b114-9c0cdca9f1d3 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.325895 Nov 02 12:45:47.446874 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 831/1665] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 1334 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:47.774640 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1128107734", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c33691cf-ac79-4e52-b490-b71908bf66b5"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:47.868589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] validate_networks() for [('c33691cf-ac79-4e52-b490-b71908bf66b5', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:48.659460 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2) Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Request method failure captured: Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 210 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmZaARvkkg7Sa_-OSMiigtvUPd7WVMezsgl2mWDvILWcX2wqLGHnlv0bTkdk-__ajedwOOB8yjz6ettpvGEUtG4uH6ZU2ND19iMQUoyjlgqNEpduCfHG1KuTB8hvGp213s_F3vK2yHSwAXBjGSWVAPZPJVp0R6_1F8xUJ29_YRcW378 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a444e4c0cab7408b8e6cc8b87398f290 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a444e4c0cab7408b8e6cc8b87398f290", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a444e4c0cab7408b8e6cc8b87398f290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a444e4c0cab7408b8e6cc8b87398f290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a444e4c0cab7408b8e6cc8b87398f290"}]}] Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a444e4c0cab7408b8e6cc8b87398f290 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-996690738 Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesAdminNegativeTest-996690738-project Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 1dea9e27e67b4fd888fb2c4085ec5bfb Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesAdminNegativeTest-996690738-project Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1128107734", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c33691cf-ac79-4e52-b490-b71908bf66b5"}]}} Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:45:48.663275 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-VolumesAdminNegativeTest-server-1128107734', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'c33691cf-ac79-4e52-b490-b71908bf66b5'}]}}} Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:48.672900 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ccda1e6-4c8c-4215-ad39-2e2c278ba8c2) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0be58f36-bc23-4f9f-a9b2-ec5201b1f4e6 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.896117 Nov 02 12:45:48.676927 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 835/1666] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 898 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:48.687332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-89b22f57-c65c-40cb-a33b-4dfcf494c051 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] Calling method '.version_select at 0x7eff5c1f0310>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:48.934318 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-89b22f57-c65c-40cb-a33b-4dfcf494c051 tempest-VolumesAdminNegativeTest-996690738 tempest-VolumesAdminNegativeTest-996690738-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050655286" status: 202 len: 0 microversion: 2.1 time: 0.252395 Nov 02 12:45:48.943353 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 832/1667] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:45:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050655286 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:45:51.406255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ea6dc027-9b6f-41e4-b172-79342f18b80c tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c4895e0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:51.532585 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ea6dc027-9b6f-41e4-b172-79342f18b80c tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cb92d0cd-3be4-4db4-a295-9c3d23677c4e" status: 200 len: 351 microversion: 2.1 time: 0.148278 Nov 02 12:45:51.533179 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 836/1668] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:45:51 2022] GET /compute/v2.1/os-volumes/cb92d0cd-3be4-4db4-a295-9c3d23677c4e => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:53.401472 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1779768329", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5ede4b7a-d8f4-4da2-9c4c-f0874c733cf4"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:53.493915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] validate_networks() for [('5ede4b7a-d8f4-4da2-9c4c-f0874c733cf4', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac3322a6-5ee4-4095-8512-e4cb813e64f6) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:54.232698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac3322a6-5ee4-4095-8512-e4cb813e64f6) Nov 02 12:45:54.236478 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.237696 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:54.237696 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] Request method failure captured: Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 217 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmaA-MlQ_jz9bJ2qqbUIcLjF0yV5LUrqJfOldMA1YQlmt4qa4mbO4scJpKQAZwfku2bu1MI0ddcy9CMuqvLPfh5g20ZykPVXnbM_6BC8SrGrMHa3jjVfZfr_XXFlLVbBidKVT-GozBY9awuvXraa-0ChFhv1ldu5NPwHUZ_ibZNYgTc Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9f93f39d26df455292e782018b938219 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-551822325 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9f93f39d26df455292e782018b938219", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9f93f39d26df455292e782018b938219"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9f93f39d26df455292e782018b938219"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9f93f39d26df455292e782018b938219"}]}] Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-551822325 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9f93f39d26df455292e782018b938219 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-551822325 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ImagesOneServerNegativeTestJSON-551822325-project Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 3c0856ee609d41c885755c0f2d12b3f5 Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-551822325-project Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1779768329", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5ede4b7a-d8f4-4da2-9c4c-f0874c733cf4"}]}} Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ImagesOneServerNegativeTestJSON-server-1779768329', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '5ede4b7a-d8f4-4da2-9c4c-f0874c733cf4'}]}}} Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:45:54.240221 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ac3322a6-5ee4-4095-8512-e4cb813e64f6) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:45:54.244854 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:45:54.249754 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a800101e-45c3-4d36-8ec0-2f3d1093a2fe tempest-ImagesOneServerNegativeTestJSON-551822325 tempest-ImagesOneServerNegativeTestJSON-551822325-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.356749 Nov 02 12:45:54.254450 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 833/1669] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:45:52 2022] POST /compute/v2.1/servers => generated 214 bytes in 1364 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:45:56.197200 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-24cb7ab8-a059-4d25-88cc-6bc28fece52c tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c1c00d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.297646 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-24cb7ab8-a059-4d25-88cc-6bc28fece52c tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/7579a0e1-bdce-4785-a09c-c91b2a596786" status: 200 len: 351 microversion: 2.1 time: 0.108622 Nov 02 12:45:56.299132 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 834/1670] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/os-volumes/7579a0e1-bdce-4785-a09c-c91b2a596786 => generated 351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:56.313351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-10fdbf5f-9959-4d15-ae8d-de65059472e4 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c335ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.507290 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-10fdbf5f-9959-4d15-ae8d-de65059472e4 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198826 Nov 02 12:45:56.511796 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 835/1671] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:56.530566 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7e798600-2409-4cab-a003-bd6751746dd5 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c1c0f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.636764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=12 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:45:56.720711 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7e798600-2409-4cab-a003-bd6751746dd5 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.182906 Nov 02 12:45:56.720711 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 836/1672] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:56.734380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b16ddd44-408f-4c94-8709-9bddd1750b97 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c214d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:56.850100 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b16ddd44-408f-4c94-8709-9bddd1750b97 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.120073 Nov 02 12:45:56.850683 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 837/1673] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:56.856326 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1034877980", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:45:56.865061 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d193b583-8530-4134-9725-d0b8d8c82712 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c78df70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.002616 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:45:57.003309 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:45:57.004084 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:45:57.012926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:45:57.014303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:45:57.059548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:45:57.099450 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d193b583-8530-4134-9725-d0b8d8c82712 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.232270 Nov 02 12:45:57.100972 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 838/1674] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Nov 2 12:45:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:57.104232 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Getting quotas for project d143d12bb4b94c3b9da7baa4aaa435a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:45:57.118237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d78e0c5f-24d7-462b-9efa-7655fbee047d tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c38a5e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.150909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Getting quotas for user dbaf52c5888f42f19575e580751ef726 and project d143d12bb4b94c3b9da7baa4aaa435a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:45:57.198459 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:45:57.206360 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:45:57.325385 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d78e0c5f-24d7-462b-9efa-7655fbee047d tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.212992 Nov 02 12:45:57.337438 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 839/1675] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:45:57 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:45:57.342443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dc40c74c-31e7-41b4-9c97-2ee7a23f5e72 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c1c0700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.534126 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dc40c74c-31e7-41b4-9c97-2ee7a23f5e72 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.195424 Nov 02 12:45:57.538297 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 840/1676] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:45:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:45:57.566714 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c15080a2-cd53-49db-bb3c-bbb48f782250 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c27a700>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.736391 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c15080a2-cd53-49db-bb3c-bbb48f782250 tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.181139 Nov 02 12:45:57.748067 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 841/1677] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Nov 2 12:45:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:45:57.754829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-05d1dace-0779-4e22-ba8d-337e6649d7dd tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] Calling method '.version_select at 0x7eff5c1c0d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:57.810686 n-d-857339-6 devstack@n-api.service[127767]: ERROR oslo.messaging._drivers.impl_rabbit [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [05c6975e-79b4-47d0-ace8-f0c43af1c9a6] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:45:58.013816 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-05d1dace-0779-4e22-ba8d-337e6649d7dd tempest-VolumesTestJSON-1726449864 tempest-VolumesTestJSON-1726449864-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.263639 Nov 02 12:45:58.025807 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 842/1678] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 12:45:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:45:58.819756 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [05c6975e-79b4-47d0-ace8-f0c43af1c9a6] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 40226. Nov 02 12:45:58.825532 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-019a8fc8-7583-42d4-bbcd-a43e8881d126 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 2.770664 Nov 02 12:45:58.826526 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 837/1679] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:45:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:45:58.838954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:45:58.839703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:45:58.947081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:58.958676 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:58.960130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:45:58.961783 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-99e76bea-2a33-4b1f-b915-bf98b9b03a91 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 200 len: 1278 microversion: 2.47 time: 0.127780 Nov 02 12:45:58.963072 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 843/1680] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:45:58 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:00.455107 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1883295745", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:00.642790 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:46:00.645274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:46:00.647153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:46:00.647668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:46:00.650915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:46:00.675885 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:00.682168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:00.683038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:00.684068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:00.684942 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:00.685651 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:00.747100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Getting quotas for project d143d12bb4b94c3b9da7baa4aaa435a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:00.759214 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Getting quotas for user dbaf52c5888f42f19575e580751ef726 and project d143d12bb4b94c3b9da7baa4aaa435a5. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:00.785769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:46:00.792633 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:46:01.198809 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8b7431c7-3c23-4a9c-9e07-3cc23de2a2f9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.748743 Nov 02 12:46:01.199481 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 838/1681] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:46:01.213902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-24119a5d-f23a-48fb-be44-920852f9f0b8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:01.221360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-24119a5d-f23a-48fb-be44-920852f9f0b8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:01.359632 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-24119a5d-f23a-48fb-be44-920852f9f0b8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "PUT /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 992 microversion: 2.47 time: 0.151013 Nov 02 12:46:01.372897 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 844/1682] 10.222.0.64 () {62 vars in 1297 bytes} [Wed Nov 2 12:46:01 2022] PUT /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 992 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:46:01.393201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:01.394295 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:01.656745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:01.676840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:01.679626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:01.681196 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a2c8d6fa-07d2-4d3f-a973-89525712abc8 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1278 microversion: 2.47 time: 0.293019 Nov 02 12:46:01.682433 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 839/1683] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:01 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1278 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:02.717219 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:02.718565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:03.013349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.029724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.040976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:03.044757 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7b9c9a34-7885-40fd-810d-54d3dc8c9adf tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1278 microversion: 2.47 time: 0.330195 Nov 02 12:46:03.046361 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 845/1684] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:02 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:04.073066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:04.073691 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:04.093659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.094167 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.094753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.097159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:04.097646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:04.098158 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:04.329934 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:04.346743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:04.348212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:04.349507 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9dce8b23-087b-4414-8517-20aa21dacd1e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1282 microversion: 2.47 time: 0.280698 Nov 02 12:46:04.366425 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 840/1685] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:04 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1282 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:05.394880 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:05.397214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:05.410666 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:05.413828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:05.414562 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.416766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:05.417507 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:05.418801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:05.757241 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.776607 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.781353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:05.783143 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-60713c30-9527-4a37-bda6-7c6223aea404 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1330 microversion: 2.47 time: 0.392393 Nov 02 12:46:05.783887 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 846/1686] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:05 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1330 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:06.817286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:06.819710 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:06.827694 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.828201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.828698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:06.836901 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:06.837812 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:06.843415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:07.165420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.189206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.194308 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:07.197036 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca85594b-c348-46b5-96ef-ea1769112cc9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1330 microversion: 2.47 time: 0.383670 Nov 02 12:46:07.203749 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 841/1687] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:06 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1330 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:08.227902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:08.229340 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:08.236299 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.237113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.237723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.238619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:08.239243 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:08.239820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:08.312278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:08.322482 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:08.323953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:08.325184 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5d2683c5-e4a6-4f43-a7f9-2d90e30becd4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1348 microversion: 2.47 time: 0.101802 Nov 02 12:46:08.325746 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 847/1688] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:08 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:09.363636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:09.368217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:09.390288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:09.396793 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:09.401931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:09.401931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:09.401931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:09.401931 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:09.565330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:09.577274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:09.579016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:09.580282 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a245ac49-193c-413e-a039-c4ba5e717356 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1336 microversion: 2.47 time: 0.230036 Nov 02 12:46:09.581501 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 842/1689] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:09 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1336 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:10.624094 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:10.624767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:10.636862 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:10.637636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:10.638272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.641893 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:10.642603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:10.643423 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:10.729469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:10.776713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:10.786215 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:10.790491 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:10.792318 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-56082db7-4527-4a8f-a39d-fa2d55fd35bd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1336 microversion: 2.47 time: 0.172317 Nov 02 12:46:10.793929 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 843/1690] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:10 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1336 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:11.184930 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-640fa11d-5a11-46d0-86cf-074e79ec1bfc tempest-ListImageFiltersNegativeTestJSON-1564982026 tempest-ListImageFiltersNegativeTestJSON-1564982026-project] Calling method '.version_select at 0x7eff5c78d790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:11.225006 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-640fa11d-5a11-46d0-86cf-074e79ec1bfc tempest-ListImageFiltersNegativeTestJSON-1564982026 tempest-ListImageFiltersNegativeTestJSON-1564982026-project] HTTP exception thrown: Image not found. Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-640fa11d-5a11-46d0-86cf-074e79ec1bfc tempest-ListImageFiltersNegativeTestJSON-1564982026 tempest-ListImageFiltersNegativeTestJSON-1564982026-project] Request method failure captured: Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/images/40e33a7c-a57a-4ed7-9115-39a5f668802c HTTP/1.1 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmaSKBpFGBk4xKu4Mjf7ke2g8lH4NAF8eN7dI7CphdYXXloDTgp5slD2K0OF_xqcsMdMj5p7Mt3PATWQmjMh0qbaGhXBqP72f3TlJakzaxEM3wV3yQlCCM2vS-0Gpzaqwa-_1Ap3_NBm-0UerEDten8ygptDCMp4JvX_MV8Ql8CCULk Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 660dc7bfd4d14513b88879ed72cc3f53 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1564982026 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_660dc7bfd4d14513b88879ed72cc3f53", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/660dc7bfd4d14513b88879ed72cc3f53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/660dc7bfd4d14513b88879ed72cc3f53"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/660dc7bfd4d14513b88879ed72cc3f53"}]}] Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1564982026 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 660dc7bfd4d14513b88879ed72cc3f53 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1564982026 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ListImageFiltersNegativeTestJSON-1564982026-project Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 2f03f274651f4398bd3bdcbb88b3c315 Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1564982026-project Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: exception: Image not found. Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '40e33a7c-a57a-4ed7-9115-39a5f668802c'} Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 40e33a7c-a57a-4ed7-9115-39a5f668802c Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Nov 02 12:46:11.228122 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get(image_id) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 40e33a7c-a57a-4ed7-9115-39a5f668802c could not be found. Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:11.233172 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-640fa11d-5a11-46d0-86cf-074e79ec1bfc tempest-ListImageFiltersNegativeTestJSON-1564982026 tempest-ListImageFiltersNegativeTestJSON-1564982026-project] Returning 404 to user: Image not found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:11.240545 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-640fa11d-5a11-46d0-86cf-074e79ec1bfc tempest-ListImageFiltersNegativeTestJSON-1564982026 tempest-ListImageFiltersNegativeTestJSON-1564982026-project] 10.222.0.64 "GET /compute/v2.1/images/40e33a7c-a57a-4ed7-9115-39a5f668802c" status: 404 len: 62 microversion: 2.1 time: 0.656167 Nov 02 12:46:11.240872 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 848/1691] 10.222.0.64 () {58 vars in 1233 bytes} [Wed Nov 2 12:46:10 2022] GET /compute/v2.1/images/40e33a7c-a57a-4ed7-9115-39a5f668802c => generated 62 bytes in 665 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:46:11.820529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:11.821297 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:11.824955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=14 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:11.828829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.829787 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.830529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:11.831492 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:11.832204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:11.832899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:11.922130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:11.936472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:11.938257 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:11.939701 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ebb098c6-f061-4a8e-9d0d-97c1928989dd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1357 microversion: 2.47 time: 0.124295 Nov 02 12:46:11.956664 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 844/1692] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:11 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1357 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:11.987880 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:11.993601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:12.003522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.004088 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.004464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.005494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.005948 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.006460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.136957 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:46:12.137384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:46:12.138010 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:46:12.138328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:46:12.138894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:46:12.427037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:12.435224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.436138 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.437421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.438396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.439186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.439776 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.515712 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a5952709-511e-46c4-ab27-bbe60e4232c1 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "POST /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584/action" status: 202 len: 1079 microversion: 2.47 time: 0.533983 Nov 02 12:46:12.542431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:12.547012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:12.547174 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 849/1693] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:46:11 2022] POST /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584/action => generated 1079 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Nov 02 12:46:12.550851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.551357 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.551852 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:12.552594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:12.553241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:12.553877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:13.035237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:13.046681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:13.049448 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:13.051594 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0ebef5f3-6753-4de1-9b3b-08957295e05b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.514434 Nov 02 12:46:13.052575 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 845/1694] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:12 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:14.093984 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:14.096644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:14.108142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:14.112168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.113130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.115937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.118126 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:14.118909 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:14.119628 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:14.284811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:14.295354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:14.297082 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:14.298736 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-215efc0f-c2f7-4453-8f63-8a862b3ee9c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.223730 Nov 02 12:46:14.299873 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 850/1695] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:14 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:15.331209 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:15.333379 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:15.337463 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:15.342888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.344000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.344552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.345352 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:15.345907 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:15.346438 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:15.439416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:15.456226 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:15.458683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:15.460007 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ba145f35-11c8-4b8c-882e-1a4b975e1a1b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.136989 Nov 02 12:46:15.463681 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 846/1696] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:15 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:16.490680 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:16.492394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:16.495270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:16.506205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:16.508638 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:16.509300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:16.513473 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:16.514827 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:16.515520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:16.600608 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:16.610315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:16.612461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:16.613738 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-76a5e5e3-cd14-4937-8527-16240a478361 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.127106 Nov 02 12:46:16.617614 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 851/1697] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:16 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:17.641406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:17.641842 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:17.654286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.658171 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.658814 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.659577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:17.660785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:17.662348 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:17.781885 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:17.792576 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:17.794344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:17.795951 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b3fe84d8-f0ae-4d7f-a914-21155b2594dc tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.159387 Nov 02 12:46:17.797154 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 847/1698] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:17 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:18.827727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:18.829969 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:18.860071 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.860881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.861989 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:18.863360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:18.864053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:18.864752 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:19.022001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.033650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.035619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:19.037200 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8dd1ebdb-4b96-422b-8a02-d9726b2ebe3a tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.218306 Nov 02 12:46:19.038629 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 852/1699] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:18 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:19.855166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82919f13-c576-4989-8125-01d7cb1f3ae5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c5fc3a0>, body: {"keypair": {"name": "tempest-keypair-1849457639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfrlU1WhQWKfKC5nA4wK7pA2nGVUAsxRfLLtrprr8XmyPehm6Qb+WQiXB31VWY6v28ORZDkb7HR831ep2wRwkNube6MwBaPPxfT7h2K/VajolG1iUOL2OFWYznazLI9KQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:19.872834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-82919f13-c576-4989-8125-01d7cb1f3ae5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:19.880463 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-82919f13-c576-4989-8125-01d7cb1f3ae5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:19.979082 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82919f13-c576-4989-8125-01d7cb1f3ae5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.596156 Nov 02 12:46:19.979733 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 848/1700] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 598 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:19.992843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c594523e-a79f-4ac0-8a53-0837f6c52b35 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c890af0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.021566 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c594523e-a79f-4ac0-8a53-0837f6c52b35 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs/tempest-keypair-1849457639" status: 200 len: 513 microversion: 2.2 time: 0.034110 Nov 02 12:46:20.033026 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 853/1701] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Nov 2 12:46:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1849457639 => generated 513 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:20.040257 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e5a9fce3-a0cb-4007-9913-ff252153f8c2 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c8ab4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.068073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.069083 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:20.087924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.088306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.088771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.089493 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:20.089949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:20.091074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:20.199537 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e5a9fce3-a0cb-4007-9913-ff252153f8c2 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849457639" status: 204 len: 0 microversion: 2.2 time: 0.168385 Nov 02 12:46:20.200715 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 849/1702] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 2 12:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1849457639 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:20.213632 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b14e9f03-f42b-4ebc-b70b-9a28f97a8edb tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c2a04c0>, body: {"keypair": {"name": "tempest-keypair-1062239300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtBdtwSktGlJudYrL4WopZ8v07hi3k1B+AeqxgGz1x7eoUxT1S3GqNdhnaJ92b3+BK/EL5p7icqLB7ddMil3n10lVvPMSp750J9PKv3LzO8Rer1PEb0FHRs1zwKoBJGDg=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:20.261953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b14e9f03-f42b-4ebc-b70b-9a28f97a8edb tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:20.269171 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b14e9f03-f42b-4ebc-b70b-9a28f97a8edb tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:20.416532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:20.418787 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b14e9f03-f42b-4ebc-b70b-9a28f97a8edb tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.210048 Nov 02 12:46:20.423307 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 850/1703] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:20 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 213 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:20.432514 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-92d97fec-453c-4aee-afe4-b7f3c05efacb tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Action: 'create', calling method: .version_select at 0x7eff5c7128b0>, body: {"keypair": {"name": "tempest-keypair-638205591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL669lf8Lxk8a95KVF9E2QA549lZ/mXJGHiL6c6TLlfksgwu+QVdZ697uPKHJr4guwZv6TUcPhYOT7Wsq/z1Q3lb4/QbVIVO84V4gUuvw/AOBQazxVGcyJWPZsuC71SZFw=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:20.438260 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:20.442678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:20.449129 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a1274ab7-a61b-4214-b1e2-1ce513747e78 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.380801 Nov 02 12:46:20.450386 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 854/1704] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:20 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:20.460818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2ca3755d-1dd9-42eb-bc67-c008b5724b82 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c1c00d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:20.475096 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-92d97fec-453c-4aee-afe4-b7f3c05efacb tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Getting quotas for project 655e1bdbfb0c469daeec1ba8a61057d4. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:20.482038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-92d97fec-453c-4aee-afe4-b7f3c05efacb tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Getting quotas for user f113dfb7876f43c293443ba1bce61302 and project 655e1bdbfb0c469daeec1ba8a61057d4. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:20.640907 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-92d97fec-453c-4aee-afe4-b7f3c05efacb tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.218116 Nov 02 12:46:20.642788 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2ca3755d-1dd9-42eb-bc67-c008b5724b82 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062239300" status: 204 len: 0 microversion: 2.2 time: 0.190181 Nov 02 12:46:20.649759 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 855/1705] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 2 12:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062239300 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:20.650579 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 851/1706] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:46:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 229 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:46:20.656446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8cd15fb1-a432-438d-979d-afec5913d950 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c875c10>, body: {"keypair": {"name": "tempest-keypair-1440467001", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:20.713112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-8cd15fb1-a432-438d-979d-afec5913d950 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:20.745112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-8cd15fb1-a432-438d-979d-afec5913d950 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:20.924570 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8cd15fb1-a432-438d-979d-afec5913d950 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.271559 Nov 02 12:46:20.926105 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 856/1707] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:20 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 276 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:20.942556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-385f5112-7e6c-435d-b658-ce9e7f6df627 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c790790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.108888 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-385f5112-7e6c-435d-b658-ce9e7f6df627 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440467001" status: 204 len: 0 microversion: 2.2 time: 0.172802 Nov 02 12:46:21.110432 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 852/1708] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 2 12:46:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1440467001 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:21.124565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-62b30d06-f02f-478a-bd04-e6afe8b7418e tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c373a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-999812772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI53w0H5vkQXPgQYnfK2AMGYEdGEGjT3+XkqMvfoVi+R8S4M217sUCQyv2xjSHXwm5wmj+DA2XKgH1ZONwwxMpT3AJzuVDEIuB7VJX48V/O3pUQ5rd3Y8rAhqA1gOIN/OQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:21.155050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-62b30d06-f02f-478a-bd04-e6afe8b7418e tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:21.155050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-62b30d06-f02f-478a-bd04-e6afe8b7418e tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:21.325486 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-62b30d06-f02f-478a-bd04-e6afe8b7418e tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.204468 Nov 02 12:46:21.326409 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 857/1709] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:21.345584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-456f5fba-c39f-45d6-8331-aca342335742 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c8abe50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2075088031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmxbo8vaY30UFwc+DbX7TWxaJ1NJJtZqyNVjOfMGGrHp34tQSoWeA4b0VNeRQR3F8I5iqlcJIekqZqrzqRhsM0obqSrxdRhFh8cVMTT1N7NZV6OxDdzF41eNQ9Rnhpx3g=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:21.383430 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-456f5fba-c39f-45d6-8331-aca342335742 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:21.396863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-456f5fba-c39f-45d6-8331-aca342335742 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:21.480772 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.481741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:21.489921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.490650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.491829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:21.492993 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:21.493707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:21.494339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:21.533686 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-456f5fba-c39f-45d6-8331-aca342335742 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.192288 Nov 02 12:46:21.534378 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 853/1710] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:21.551693 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-acc38cea-c08f-4085-8c7c-6194c7e0082c tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c2a0d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1348881531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkirPAUPoAk3Lre6TGHMYPyTq095L6rPQLdAdCm3svXi7caYUzwKe27e9HJ2BWXkhQhANc4ZePCHfeHASDGeT29KSlcqz+2xxYw/uZ2ouFyCbif5q2o5A0LYvNuJQyP7g=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:21.576947 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-acc38cea-c08f-4085-8c7c-6194c7e0082c tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:21.586144 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-acc38cea-c08f-4085-8c7c-6194c7e0082c tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:21.653356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:21.669446 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:21.671806 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:21.677759 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-940bf3b2-f548-4002-92cd-6d997e632b2b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.201800 Nov 02 12:46:21.679590 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 858/1711] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:21 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:21.703029 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-acc38cea-c08f-4085-8c7c-6194c7e0082c tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.156575 Nov 02 12:46:21.704044 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 854/1712] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:21 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Nov 02 12:46:21.718479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6d03d42b-3047-48d7-a273-3c707d8ecc80 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c78d790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.729300 n-d-857339-6 devstack@n-api.service[127766]: WARNING oslo_db.sqlalchemy.utils [None req-6d03d42b-3047-48d7-a273-3c707d8ecc80 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:46:21.749975 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6d03d42b-3047-48d7-a273-3c707d8ecc80 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.036369 Nov 02 12:46:21.750851 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 859/1713] 10.222.0.64 () {60 vars in 1177 bytes} [Wed Nov 2 12:46:21 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:21.763275 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-33afb58b-56e8-4700-b5fa-9dd52a89eb5f tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5d02d310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:21.890910 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-33afb58b-56e8-4700-b5fa-9dd52a89eb5f tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1348881531" status: 204 len: 0 microversion: 2.2 time: 0.131874 Nov 02 12:46:21.893008 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 855/1714] 10.222.0.64 () {60 vars in 1321 bytes} [Wed Nov 2 12:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1348881531 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:21.902566 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6f650105-fc63-4094-acde-c89698495f74 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c27af70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.079196 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6f650105-fc63-4094-acde-c89698495f74 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2075088031" status: 204 len: 0 microversion: 2.2 time: 0.181091 Nov 02 12:46:22.088581 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 860/1715] 10.222.0.64 () {60 vars in 1321 bytes} [Wed Nov 2 12:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2075088031 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:22.089531 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-12228e2e-85bf-4ca8-a5de-3951f282d515 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c6731f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.293919 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-12228e2e-85bf-4ca8-a5de-3951f282d515 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-999812772" status: 204 len: 0 microversion: 2.2 time: 0.206968 Nov 02 12:46:22.293919 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 856/1716] 10.222.0.64 () {60 vars in 1318 bytes} [Wed Nov 2 12:46:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-999812772 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:22.307478 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bc6be82d-d2f4-401e-b7ad-d3cb02c575e3 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c335e50>, body: {"keypair": {"name": "tempest-keypair-1404602424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaXRwS71SJR0v8vCwJ/jyvNAGojQrglqUKZABWI7hLWsgPgV5tSGrQ28c126gZWIRlMUKOJAGTtaT07s89EFf9tA4yA8fBMJ9F54UeH25Bz3SCOlOAZNkzTaf8UUmu6Rg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:22.325848 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-bc6be82d-d2f4-401e-b7ad-d3cb02c575e3 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:22.332177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-bc6be82d-d2f4-401e-b7ad-d3cb02c575e3 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:22.452120 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bc6be82d-d2f4-401e-b7ad-d3cb02c575e3 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.151252 Nov 02 12:46:22.453537 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 861/1717] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Nov 2 12:46:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Nov 02 12:46:22.465775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-fd7aa43d-0860-4e25-b696-e06c077b9222 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c14dca0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.479323 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-fd7aa43d-0860-4e25-b696-e06c077b9222 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs/tempest-keypair-1404602424" status: 200 len: 513 microversion: 2.2 time: 0.018800 Nov 02 12:46:22.479930 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 857/1718] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Nov 2 12:46:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1404602424 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:22.491880 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1742240b-de15-496b-9698-a543b33ba244 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c38af70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.495795 n-d-857339-6 devstack@n-api.service[127766]: WARNING oslo_db.sqlalchemy.utils [None req-1742240b-de15-496b-9698-a543b33ba244 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:46:22.501178 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1742240b-de15-496b-9698-a543b33ba244 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.013386 Nov 02 12:46:22.501774 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 862/1719] 10.222.0.64 () {60 vars in 1177 bytes} [Wed Nov 2 12:46:22 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:22.514165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cce8837c-a30a-49ea-8ecd-2544826d8385 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c5fc4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.614057 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cce8837c-a30a-49ea-8ecd-2544826d8385 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404602424" status: 204 len: 0 microversion: 2.2 time: 0.103153 Nov 02 12:46:22.619758 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 858/1720] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 2 12:46:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1404602424 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:22.629066 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Action: 'create', calling method: .version_select at 0x7eff5c4ad820>, body: {"keypair": {"name": "tempest-keypair-1400589853", "type": "x509"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:22.649875 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:22.657159 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:22.677474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.processutils [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp9w7k_9ac/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9w7k_9ac/temp.key -subj /CN=a521c14dd3a94d40abf3fffec6100b8a -extensions v3_req_client {{(pid=127766) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 12:46:22.717707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:22.719001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:22.728350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:22.728350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:22.728770 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:22.730316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:22.731276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:22.731898 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:22.763527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=53 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:22.990863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:22.992169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:22.997977 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:23.001902 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-25101373-f99d-42ee-9d57-001064bf368f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.296107 Nov 02 12:46:23.002696 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 859/1721] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:22 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:23.045416 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.processutils [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp9w7k_9ac/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp9w7k_9ac/temp.key -subj /CN=a521c14dd3a94d40abf3fffec6100b8a -extensions v3_req_client" returned: 0 in 0.366s {{(pid=127766) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 12:46:23.046470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.processutils [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp9w7k_9ac/temp.key -password pass: {{(pid=127766) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 02 12:46:23.082831 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.processutils [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp9w7k_9ac/temp.key -password pass:" returned: 0 in 0.036s {{(pid=127766) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 02 12:46:23.284953 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:46:23.302404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Getting quotas for user a521c14dd3a94d40abf3fffec6100b8a and project 243fce1f12b344609d5c493e72b65119. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:46:23.350122 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0a07f630-8d9b-4acb-9cef-49ecb58eeb33 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.724243 Nov 02 12:46:23.352272 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 863/1722] 10.222.0.64 () {62 vars in 1198 bytes} [Wed Nov 2 12:46:22 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:23.362970 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-07c0bcc6-1c6e-4443-95ea-353df7686e51 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c1314c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:23.390375 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-07c0bcc6-1c6e-4443-95ea-353df7686e51 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs/tempest-keypair-1400589853" status: 200 len: 1534 microversion: 2.2 time: 0.028554 Nov 02 12:46:23.395038 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 860/1723] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Nov 2 12:46:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1400589853 => generated 1534 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:46:23.407995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b6f02e7c-6411-4ad3-9bd0-7c82087b5fc5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c214d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:23.417077 n-d-857339-6 devstack@n-api.service[127766]: WARNING oslo_db.sqlalchemy.utils [None req-b6f02e7c-6411-4ad3-9bd0-7c82087b5fc5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:46:23.426625 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b6f02e7c-6411-4ad3-9bd0-7c82087b5fc5 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.022765 Nov 02 12:46:23.434774 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 864/1724] 10.222.0.64 () {60 vars in 1177 bytes} [Wed Nov 2 12:46:23 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:46:23.440694 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d49a575c-70b6-4011-90f9-817f9413d477 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] Calling method '.version_select at 0x7eff5c5fca60>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:23.554884 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d49a575c-70b6-4011-90f9-817f9413d477 tempest-KeyPairsV22TestJSON-2034415427 tempest-KeyPairsV22TestJSON-2034415427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400589853" status: 204 len: 0 microversion: 2.2 time: 0.118450 Nov 02 12:46:23.556154 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 861/1725] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Nov 2 12:46:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400589853 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:46:24.036247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:24.037042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:24.054336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.054881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.056402 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.057235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:24.057774 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:24.058211 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:24.192417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:24.207194 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:24.211163 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:24.213101 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-820acd32-6af6-463d-8b97-9c7fbd822237 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.181228 Nov 02 12:46:24.214815 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 865/1726] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:24 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:25.239627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:25.241587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:25.248980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:25.249475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:25.250115 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:25.250997 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:25.251458 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:25.252058 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:25.374334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:25.384319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:25.386861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:25.388614 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9be8cd9e-233b-4b97-a35c-17cd89ab76da tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.152853 Nov 02 12:46:25.389205 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 862/1727] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:25 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:25.623419 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1310853469", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9ae29ae5-a023-4709-af7a-eee00b2fc52c"}, {"port": "fd799026-d30a-4e80-b53f-b4f005c12579", "tag": "port-1"}, {"port": "532cb00b-f4f2-4e37-a1a6-6c857f5db7ee", "tag": "port-2"}, {"uuid": "2aa0f835-d302-41a4-b25d-dd1d4ef88256", "tag": "net-1"}, {"uuid": "2aa0f835-d302-41a4-b25d-dd1d4ef88256"}, {"uuid": "917b6b1b-e5d9-4a76-9898-f8dc059db370", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "917b6b1b-e5d9-4a76-9898-f8dc059db370", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a1eacdd5-9e7d-4534-bba6-9280a9bd3726", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5fa2ef16-14e0-4a3b-9600-f4bf1430b0e6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "42e46de8-d829-49e1-8a33-d979f16a0322", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1711787978"}], "key_name": "tempest-keypair-638205591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:25.780339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] validate_networks() for [('9ae29ae5-a023-4709-af7a-eee00b2fc52c', None, None, None, None, None), (None, None, 'fd799026-d30a-4e80-b53f-b4f005c12579', None, None, None), (None, None, '532cb00b-f4f2-4e37-a1a6-6c857f5db7ee', None, None, None), ('2aa0f835-d302-41a4-b25d-dd1d4ef88256', None, None, None, None, None), ('2aa0f835-d302-41a4-b25d-dd1d4ef88256', None, None, None, None, None), ('917b6b1b-e5d9-4a76-9898-f8dc059db370', '10.2.2.100', None, None, None, None), ('917b6b1b-e5d9-4a76-9898-f8dc059db370', '10.2.2.200', None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:46:26.414520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:26.415102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:26.422398 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:26.423250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:26.423855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:26.424796 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:26.425472 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:26.426077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:26.526851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:26.539283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:26.552055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:26.553483 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e1a9b8ea-596a-4874-8f92-264dd067eb8d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.142894 Nov 02 12:46:26.594831 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 863/1728] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:26 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71ec6074-720c-4b54-81dd-db8be2d5aa30) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:46:27.097273 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71ec6074-720c-4b54-81dd-db8be2d5aa30) Nov 02 12:46:27.102439 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.106035 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:46:27.106035 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Request method failure captured: Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 1344 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmYyCZ2YL1yoYcCOYeztSphH4vx5IMajwFyL6_gzEKP1scl0HWCQGM3VSsr7p4MMFhF6YU7cLnrFPwR7oBQMZYbZy6MFqgjGXWGXkY2qraB0F-jKVN6Dn16_8e3RlDGzJxlrS3MCkRBJ4FDeZpZ4ZIUsoZus5aGufbcKxc51AHuElP4 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.32 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 655e1bdbfb0c469daeec1ba8a61057d4 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TaggedBootDevicesTest-1018316796 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_655e1bdbfb0c469daeec1ba8a61057d4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/655e1bdbfb0c469daeec1ba8a61057d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/655e1bdbfb0c469daeec1ba8a61057d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/655e1bdbfb0c469daeec1ba8a61057d4"}]}] Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TaggedBootDevicesTest-1018316796 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 655e1bdbfb0c469daeec1ba8a61057d4 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1018316796 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TaggedBootDevicesTest-1018316796-project Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: f113dfb7876f43c293443ba1bce61302 Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TaggedBootDevicesTest-1018316796-project Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-device-tagging-server-1310853469", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9ae29ae5-a023-4709-af7a-eee00b2fc52c"}, {"port": "fd799026-d30a-4e80-b53f-b4f005c12579", "tag": "port-1"}, {"port": "532cb00b-f4f2-4e37-a1a6-6c857f5db7ee", "tag": "port-2"}, {"uuid": "2aa0f835-d302-41a4-b25d-dd1d4ef88256", "tag": "net-1"}, {"uuid": "2aa0f835-d302-41a4-b25d-dd1d4ef88256"}, {"uuid": "917b6b1b-e5d9-4a76-9898-f8dc059db370", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "917b6b1b-e5d9-4a76-9898-f8dc059db370", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a1eacdd5-9e7d-4534-bba6-9280a9bd3726", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5fa2ef16-14e0-4a3b-9600-f4bf1430b0e6", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "42e46de8-d829-49e1-8a33-d979f16a0322", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1711787978"}], "key_name": "tempest-keypair-638205591", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1310853469', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '9ae29ae5-a023-4709-af7a-eee00b2fc52c'}, {'port': 'fd799026-d30a-4e80-b53f-b4f005c12579', 'tag': 'port-1'}, {'port': '532cb00b-f4f2-4e37-a1a6-6c857f5db7ee', 'tag': 'port-2'}, {'uuid': '2aa0f835-d302-41a4-b25d-dd1d4ef88256', 'tag': 'net-1'}, {'uuid': '2aa0f835-d302-41a4-b25d-dd1d4ef88256'}, {'uuid': '917b6b1b-e5d9-4a76-9898-f8dc059db370', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '917b6b1b-e5d9-4a76-9898-f8dc059db370', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': 'a1eacdd5-9e7d-4534-bba6-9280a9bd3726', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '5fa2ef16-14e0-4a3b-9600-f4bf1430b0e6', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': '42e46de8-d829-49e1-8a33-d979f16a0322', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1711787978'}], 'key_name': 'tempest-keypair-638205591', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:27.110950 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:46:27.116883 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-71ec6074-720c-4b54-81dd-db8be2d5aa30) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-63567850-2346-4abd-9e4a-9a762c65361c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.32 time: 1.502324 Nov 02 12:46:27.129494 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 866/1729] 10.222.0.64 () {62 vars in 1189 bytes} [Wed Nov 2 12:46:25 2022] POST /compute/v2.1/servers => generated 214 bytes in 1509 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:46:27.137674 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0c58383d-55ea-4493-98ee-6e478002688c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] Calling method '.version_select at 0x7eff5c131430>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:27.152732 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:27.348224 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0c58383d-55ea-4493-98ee-6e478002688c tempest-TaggedBootDevicesTest-1018316796 tempest-TaggedBootDevicesTest-1018316796-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-638205591" status: 204 len: 0 microversion: 2.32 time: 0.214053 Nov 02 12:46:27.348869 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 864/1730] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Nov 2 12:46:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-638205591 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:46:27.590313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:27.591351 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:27.603238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.603996 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.604723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.605626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:27.606460 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:27.607056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:27.716405 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:27.728029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:27.729433 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:27.731642 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-58bd8549-2faa-4e7e-8705-b5442860937f tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.145540 Nov 02 12:46:27.745060 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 867/1731] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:27 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:28.745683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c0f8c82-f766-485d-9c03-5e561168541e tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Action: 'create', calling method: .version_select at 0x7eff5ca5a550>, body: {"pool": null} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:28.761271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:28.763713 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:28.772142 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.773332 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.774079 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.774832 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:28.775394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:28.776059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:28.888328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:28.901359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:28.902960 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:28.904256 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0d6bc3a8-c6bb-4ce4-9903-49b8db369488 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.149278 Nov 02 12:46:28.904940 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 868/1732] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:28 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:29.931278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:29.937968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:29.945409 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.945988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.946523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:29.949574 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:29.950867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:29.952674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:30.121019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:30.133122 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:30.134615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:30.136685 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-39ea75de-8a27-41e4-84c0-c895de22fac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.209768 Nov 02 12:46:30.165131 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 869/1733] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:29 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:31.053187 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c0f8c82-f766-485d-9c03-5e561168541e tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.602790 Nov 02 12:46:31.061948 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 865/1734] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:46:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:31.066494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-325d7328-367a-43bd-9d6d-5d804c875406 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5c6c43a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.169423 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.169961 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:31.182978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:31.183490 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:31.183935 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:31.184698 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:31.185156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:31.189124 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:31.291836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.301237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.302720 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:31.304011 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-037358b1-05c6-4b18-851e-e254c1eee15b tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.138918 Nov 02 12:46:31.304938 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 866/1735] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:31.352195 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-325d7328-367a-43bd-9d6d-5d804c875406 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips/e6f2f835-50c4-46a7-b6fd-0d6ab93d0c65" status: 200 len: 142 microversion: 2.1 time: 0.289438 Nov 02 12:46:31.353282 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 870/1736] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/os-floating-ips/e6f2f835-50c4-46a7-b6fd-0d6ab93d0c65 => generated 142 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:31.374212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3cda88c2-c9c5-4056-88a8-5ff2902aff2e tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5c635790>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:31.596345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=20 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:31.730473 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3cda88c2-c9c5-4056-88a8-5ff2902aff2e tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.360360 Nov 02 12:46:31.731079 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 867/1737] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Nov 2 12:46:31 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:31.747481 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-86dfaef7-67bc-49d3-bc28-7f00c1ceb199 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5c726d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:32.330056 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:32.331300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:32.344527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.345315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.346276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.349325 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:32.351156 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:32.353347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:32.498354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:32.524279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:32.528929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:32.530427 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ae807499-db8f-4371-9865-3f77a7f1002d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.204451 Nov 02 12:46:32.533856 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 868/1738] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:32 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:33.287577 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-86dfaef7-67bc-49d3-bc28-7f00c1ceb199 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/e6f2f835-50c4-46a7-b6fd-0d6ab93d0c65" status: 202 len: 0 microversion: 2.1 time: 1.547691 Nov 02 12:46:33.288775 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 871/1739] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:46:31 2022] DELETE /compute/v2.1/os-floating-ips/e6f2f835-50c4-46a7-b6fd-0d6ab93d0c65 => generated 0 bytes in 1550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:33.302266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-26e4df24-bcd9-4f44-9d62-1e0b2ffb3852 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Action: 'create', calling method: .version_select at 0x7eff5c635dc0>, body: {"pool": null} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:46:33.563135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=20 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:33.563135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:33.563135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:33.568315 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.568840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.569325 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.570053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:33.570492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:33.570913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:33.645674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:33.655597 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:33.657074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:33.658333 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cea949e2-280a-4ede-8633-71327e862685 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.104151 Nov 02 12:46:33.660020 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 872/1740] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:33 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:34.685779 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:34.686456 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:34.699073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.699573 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.700420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.702758 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:34.703458 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:34.705407 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:34.893622 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:34.916989 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:34.924563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:34.930598 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-afc16ca2-cb51-4add-b159-b314724f7425 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.248895 Nov 02 12:46:34.933512 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 873/1741] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:34 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:35.964802 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:35.965475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:35.982533 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:35.995068 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:36.392470 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-26e4df24-bcd9-4f44-9d62-1e0b2ffb3852 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.097214 Nov 02 12:46:36.393157 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 869/1742] 10.222.0.64 () {60 vars in 1170 bytes} [Wed Nov 2 12:46:33 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:46:36.406616 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-976ddb6d-c1f7-433c-98f5-b48f7035ba16 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5c6730d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:36.417924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:36.432606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:36.433964 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:36.435245 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-be185801-0f2b-4904-9a93-ca2f3e802448 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.475705 Nov 02 12:46:36.435822 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 874/1743] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:35 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:37.471470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:37.471470 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:37.478896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:37.482308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.482820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.483264 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:37.489090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:37.489673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:37.490137 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:37.768310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.784616 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.793052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:37.797419 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-82ee459c-dfff-4519-8813-65358fe4088d tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.337950 Nov 02 12:46:37.808589 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 875/1744] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:37 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:38.464198 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-976ddb6d-c1f7-433c-98f5-b48f7035ba16 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a" status: 202 len: 0 microversion: 2.1 time: 2.059596 Nov 02 12:46:38.467739 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 870/1745] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:46:36 2022] DELETE /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a => generated 0 bytes in 2066 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:46:38.479286 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5c726b80>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.645338 n-d-857339-6 devstack@n-api.service[127766]: DEBUG neutronclient.v2_0.client [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d9ca3813-b2e0-467e-9959-9b2287971a1a could not be found", "detail": ""}} {{(pid=127766) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:46:38.646292 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] HTTP exception thrown: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Request method failure captured: Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a HTTP/1.1 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmakD0GDf1o-6EjTmwXbdFz4iYSO6laJzuNmhziO2f3qdGISk1v3obuxur9qSbSBSbm9PSzQEvynZABBu8RHLOUUtX90QJm9UFUh24w_BKhT2V9vS3NDR4xyS0PSNe7-egVWOdHlshf6lC9PYbpMoUI3ASae8iKAqq9rP28OjKf4Wq8 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 445482b5acc24f018ca5337882bae30e Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "tempest-type-1942081283", "name": "tempest-service-326263692", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_445482b5acc24f018ca5337882bae30e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/445482b5acc24f018ca5337882bae30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "tempest-type-1431231808", "name": "tempest-service-324635185", "endpoints": [{"region": "tempest-region-1265740464", "internalURL": "https://url-77987636.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "tempest-type-1907709583", "name": "tempest-service-915494116", "endpoints": []}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "tempest-type-271287811", "name": "tempest-service-630425757", "endpoints": [{"region": "tempest-region-2112400859", "publicURL": "https://url-1000743534.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/445482b5acc24f018ca5337882bae30e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/445482b5acc24f018ca5337882bae30e"}]}] Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 445482b5acc24f018ca5337882bae30e Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-FloatingIPsTestJSON-1753079950-project Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: fe54cc37cbe341ae8a4ccff43b17cb33 Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-FloatingIPsTestJSON-1753079950-project Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: exception: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'd9ca3813-b2e0-467e-9959-9b2287971a1a'} Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:46:38.649793 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d9ca3813-b2e0-467e-9959-9b2287971a1a could not be found Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-70490ce0-03f0-4ce5-a021-aebc5b93b6da'] Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a. Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.654195 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.659394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Returning 404 to user: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:38.660465 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3c5defd2-47f2-49c5-bcbf-f744d1d2fc21 tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "GET /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a" status: 404 len: 111 microversion: 2.1 time: 0.186536 Nov 02 12:46:38.661554 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 876/1746] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:38.675406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Calling method '.version_select at 0x7eff5d02d670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.753951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG neutronclient.v2_0.client [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP d9ca3813-b2e0-467e-9959-9b2287971a1a could not be found", "detail": ""}} {{(pid=127767) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Nov 02 12:46:38.754737 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] HTTP exception thrown: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Request method failure captured: Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a HTTP/1.1 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmakD0GDf1o-6EjTmwXbdFz4iYSO6laJzuNmhziO2f3qdGISk1v3obuxur9qSbSBSbm9PSzQEvynZABBu8RHLOUUtX90QJm9UFUh24w_BKhT2V9vS3NDR4xyS0PSNe7-egVWOdHlshf6lC9PYbpMoUI3ASae8iKAqq9rP28OjKf4Wq8 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 445482b5acc24f018ca5337882bae30e Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "tempest-type-1942081283", "name": "tempest-service-326263692", "endpoints": []}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_445482b5acc24f018ca5337882bae30e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/445482b5acc24f018ca5337882bae30e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "tempest-type-1431231808", "name": "tempest-service-324635185", "endpoints": [{"region": "tempest-region-1265740464", "internalURL": "https://url-77987636.com"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "tempest-type-1907709583", "name": "tempest-service-915494116", "endpoints": []}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "tempest-type-271287811", "name": "tempest-service-630425757", "endpoints": [{"region": "tempest-region-2112400859", "publicURL": "https://url-1000743534.com"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/445482b5acc24f018ca5337882bae30e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/445482b5acc24f018ca5337882bae30e"}]}] Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 445482b5acc24f018ca5337882bae30e Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1753079950 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-FloatingIPsTestJSON-1753079950-project Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: fe54cc37cbe341ae8a4ccff43b17cb33 Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-FloatingIPsTestJSON-1753079950-project Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: exception: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'd9ca3813-b2e0-467e-9959-9b2287971a1a'} Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Nov 02 12:46:38.762214 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP d9ca3813-b2e0-467e-9959-9b2287971a1a could not be found Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6f7fb1a9-366a-45cf-be05-b104d7c3c1b4'] Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a. Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:46:38.779517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] Returning 404 to user: Floating IP not found for ID d9ca3813-b2e0-467e-9959-9b2287971a1a {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:38.785542 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7be0418d-47e1-45b9-ad1e-942bdf64caba tempest-FloatingIPsTestJSON-1753079950 tempest-FloatingIPsTestJSON-1753079950-project] 10.222.0.64 "DELETE /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a" status: 404 len: 111 microversion: 2.1 time: 0.110305 Nov 02 12:46:38.786213 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 871/1747] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 12:46:38 2022] DELETE /compute/v2.1/os-floating-ips/d9ca3813-b2e0-467e-9959-9b2287971a1a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:46:38.831906 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:38.838062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:38.933557 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:39.067673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.083759 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.092627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:39.098664 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-407086ac-0432-4ce0-abf1-df77db6c95bb tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.275627 Nov 02 12:46:39.101842 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 877/1748] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:38 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:40.128267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:40.128919 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:40.141658 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.142416 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.146764 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.151713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:40.152457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:40.153119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:40.279311 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.293755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.295305 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:40.296574 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d930436a-2674-4c18-85f4-7f7f8a7200a4 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.172706 Nov 02 12:46:40.297131 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 872/1749] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:40 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:41.334790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:41.335823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:41.352262 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.353111 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.353672 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.354532 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:41.355202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:41.359390 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:41.844090 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.868170 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.873251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:41.876748 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8930b9f5-c5b0-47c6-956a-76316aaf2fc2 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.554034 Nov 02 12:46:41.897897 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 878/1750] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:41 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:42.914228 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:42.915552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:42.937522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.940542 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.941902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:42.943672 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:42.950476 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:42.953635 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:43.185974 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.201590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.218995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:43.218995 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5c6a1327-6843-4bc1-a399-2f44a21cc151 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.296395 Nov 02 12:46:43.218995 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 873/1751] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:42 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:44.241893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:44.241893 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:44.297795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.304961 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.305598 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.322228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:44.322926 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:44.323393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:44.784070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.802006 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.808347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:44.812634 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-da39460a-bde3-44d7-9419-d2b26debc8b6 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.579529 Nov 02 12:46:44.815201 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 879/1752] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:44 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:45.850612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:45.851239 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:45.862522 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.867358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.867811 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:45.872567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:45.873166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:45.873739 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:46.100612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.115078 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.119012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:46.123919 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8c995f72-8201-44a0-b61e-d907c3436045 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1366 microversion: 2.47 time: 0.278151 Nov 02 12:46:46.130221 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 874/1753] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:45 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:47.157921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:47.158564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:47.171593 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.173718 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.174484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.177980 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:47.179288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:47.180920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:47.284547 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:47.294986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:47.302260 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:47.304365 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-16443959-b164-478b-a76a-5c1055ab5ac3 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1372 microversion: 2.47 time: 0.154081 Nov 02 12:46:47.305502 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 880/1754] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:47 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:48.334978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:48.336291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:48.348437 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.349084 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.349413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.350157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:48.350616 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:48.351073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:48.503464 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:48.525338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:48.529577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:48.530851 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-adfbb943-2721-4eda-86d8-7c7b355beaba tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1372 microversion: 2.47 time: 0.200472 Nov 02 12:46:48.532897 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 875/1755] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:48 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:49.567780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:49.568417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:49.580668 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:49.581326 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:49.581868 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:49.582814 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:49.586324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:49.588012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:49.893781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.913613 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.920182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.926045 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e257ad69-7bbd-4761-ab9f-0b1a753ba6fd tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1357 microversion: 2.47 time: 0.366447 Nov 02 12:46:49.926561 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 881/1756] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:49 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1357 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:49.967378 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:49.976930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:49.978036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Searching by: {'deleted': False, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5'} {{(pid=127767) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:46:49.996077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:49.996593 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:49.997036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:49.997775 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:49.998237 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.000081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.315477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.multi_cell_list [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=127767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:46:50.474736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:50.486626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.487506 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.488722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.513351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:50.521594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:50.579437 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-06ab6f7d-e100-44bd-bda8-243ae110a990 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.615901 Nov 02 12:46:50.580525 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 876/1757] 10.222.0.64 () {60 vars in 1187 bytes} [Wed Nov 2 12:46:49 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:50.616464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:50.617760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:50.628994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.629492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.630375 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.632867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:50.636184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:50.636876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:50.692459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Going to try to terminate instance {{(pid=127766) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:46:50.982482 n-d-857339-6 devstack@n-api.service[127766]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [601a8066-82ee-46cd-858c-28b0c68806b7] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:46:51.984387 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [601a8066-82ee-46cd-858c-28b0c68806b7] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 41556. Nov 02 12:46:52.108734 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5da23ea0-6701-4a12-80b9-c2ff852ebd7c tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 204 len: 0 microversion: 2.47 time: 1.496101 Nov 02 12:46:52.110269 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 882/1758] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:46:50 2022] DELETE /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 0 bytes in 1498 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:46:52.118203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:52.118866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:52.142612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.144087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.148353 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.149424 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:52.151585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:52.153377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:52.497985 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:52.528951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:52.536128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:52.538662 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-42ddadb0-868b-4c53-8275-746828a6e861 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1363 microversion: 2.47 time: 0.424078 Nov 02 12:46:52.553715 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 877/1759] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:52 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:53.568891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:53.570506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:53.583781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:53.584316 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:53.584794 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:53.588905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:53.588905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:53.588905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:53.744359 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:53.764098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:53.766479 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:53.768454 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-78b2bc3b-4de2-4c03-859f-2be97cbe847e tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1363 microversion: 2.47 time: 0.204060 Nov 02 12:46:53.770743 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 883/1760] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:53 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:54.799804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:54.801290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:54.811479 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.815146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.815845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.816888 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.819507 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.820162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.898329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:54.898829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:54.899274 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:54.899733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lazy-loading 'fault' on Instance uuid b33ef83c-b3db-4c28-9663-91a920f64584 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:46:55.498149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:55.501513 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=76 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:46:55.530926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:55.537428 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:55.539080 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c7845ed9-5244-4129-ad87-8a2c7c3496ce tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 200 len: 1368 microversion: 2.47 time: 0.743639 Nov 02 12:46:55.540930 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 878/1761] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:54 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 1368 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:56.580480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:56.581027 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: b33ef83c-b3db-4c28-9663-91a920f64584] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:56.610770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.611284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.611736 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.618724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.619680 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.620290 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.658349 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] HTTP exception thrown: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Request method failure captured: Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 HTTP/1.1 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmaDE_zWWzcBXwRPZfMdTaDVWPAUGnPmNW9LvrtfTn7C8x_H6XKwMYLghkequWCo7MAcF0N7TpVEcx2d6wO3MaRNSSWcxRjhTs8UhT2fC2Akfb1bkMAdXpXAMwZztJCkNdvqaCzbvNHm_du9H19q83L40dWBlK_eaZRDGvhK47uxFFY Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d143d12bb4b94c3b9da7baa4aaa435a5 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerShowV247Test-582320599 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d143d12bb4b94c3b9da7baa4aaa435a5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d143d12bb4b94c3b9da7baa4aaa435a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d143d12bb4b94c3b9da7baa4aaa435a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d143d12bb4b94c3b9da7baa4aaa435a5"}]}] Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerShowV247Test-582320599 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d143d12bb4b94c3b9da7baa4aaa435a5 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerShowV247Test-582320599 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerShowV247Test-582320599-project Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: dbaf52c5888f42f19575e580751ef726 Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerShowV247Test-582320599-project Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'b33ef83c-b3db-4c28-9663-91a920f64584'} Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:46:56.660471 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. Nov 02 12:46:56.665701 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:46:56.667042 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Returning 404 to user: Instance b33ef83c-b3db-4c28-9663-91a920f64584 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:46:56.668085 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9bf72b23-7551-44de-9aa9-51af3e67cb94 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584" status: 404 len: 111 microversion: 2.47 time: 0.098328 Nov 02 12:46:56.668893 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 884/1762] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:56 2022] GET /compute/v2.1/servers/b33ef83c-b3db-4c28-9663-91a920f64584 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:46:56.677709 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:56.678299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:56.693197 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.694283 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.694733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.695475 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:56.695932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:56.696355 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:56.769211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:46:57.337224 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c5e15e6e-5932-4ad7-9d5c-b7e2797e4916 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "DELETE /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 204 len: 0 microversion: 2.47 time: 0.658759 Nov 02 12:46:57.341027 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 879/1763] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:46:56 2022] DELETE /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:46:57.349367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:57.350534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:57.363278 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.364015 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.364849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.366907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:57.376078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:57.376904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:57.607333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:57.624468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:57.625965 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:57.627504 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5800c15b-274e-44ae-9d47-f5de0cce9a09 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 200 len: 1363 microversion: 2.47 time: 0.282044 Nov 02 12:46:57.628203 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 885/1764] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:57 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:46:58.654389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:58.655095 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:58.669591 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:58.670085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:58.670521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:58.671219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:58.671668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:58.672087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:58.805191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:58.826470 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:58.830088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:46:58.833566 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-91a0eb4b-971f-4dce-85b4-13dd290752df tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 200 len: 1363 microversion: 2.47 time: 0.182724 Nov 02 12:46:58.836041 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 880/1765] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:58 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:46:59.875069 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:46:59.876294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:46:59.887059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:59.889795 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:59.890554 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:59.892280 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:59.894826 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:59.895505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:59.998216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:46:59.998216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:46:59.998216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:46:59.998216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lazy-loading 'fault' on Instance uuid 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:47:00.297276 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.309888 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.312997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:00.321891 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2766ebfb-0063-4afb-ad8a-3995758889c0 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 200 len: 1368 microversion: 2.47 time: 0.450632 Nov 02 12:47:00.348542 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 886/1766] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:46:59 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 1368 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:01.358094 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:01.358995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:01.363027 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:01.366231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:01.368599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:01.385114 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.388159 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.388900 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.391110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.397586 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.398391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.456039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:01.456580 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:01.457021 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:01.457473 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lazy-loading 'fault' on Instance uuid 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:47:01.620323 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.629853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.633075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbaf52c5888f42f19575e580751ef726', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd143d12bb4b94c3b9da7baa4aaa435a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:01.635116 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a569987f-08df-44ca-a82c-cba4f5e05cca tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 200 len: 1368 microversion: 2.47 time: 0.282183 Nov 02 12:47:01.636613 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 881/1767] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:01 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:02.665937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:02.668651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] [instance: 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:02.710813 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.718152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.719496 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.720664 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:02.724712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:02.727674 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:02.756094 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] HTTP exception thrown: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Request method failure captured: Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 HTTP/1.1 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmaDE_zWWzcBXwRPZfMdTaDVWPAUGnPmNW9LvrtfTn7C8x_H6XKwMYLghkequWCo7MAcF0N7TpVEcx2d6wO3MaRNSSWcxRjhTs8UhT2fC2Akfb1bkMAdXpXAMwZztJCkNdvqaCzbvNHm_du9H19q83L40dWBlK_eaZRDGvhK47uxFFY Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d143d12bb4b94c3b9da7baa4aaa435a5 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerShowV247Test-582320599 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d143d12bb4b94c3b9da7baa4aaa435a5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d143d12bb4b94c3b9da7baa4aaa435a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d143d12bb4b94c3b9da7baa4aaa435a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d143d12bb4b94c3b9da7baa4aaa435a5"}]}] Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerShowV247Test-582320599 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d143d12bb4b94c3b9da7baa4aaa435a5 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerShowV247Test-582320599 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerShowV247Test-582320599-project Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: dbaf52c5888f42f19575e580751ef726 Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerShowV247Test-582320599-project Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7'} Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:02.759628 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. Nov 02 12:47:02.763655 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:47:02.767520 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] Returning 404 to user: Instance 853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:47:02.768788 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-59ef03d5-db74-4ec5-9f32-f9c2b49420d9 tempest-ServerShowV247Test-582320599 tempest-ServerShowV247Test-582320599-project] 10.222.0.64 "GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7" status: 404 len: 111 microversion: 2.47 time: 0.109689 Nov 02 12:47:02.769773 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 887/1768] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:02 2022] GET /compute/v2.1/servers/853ebe1f-1d3a-44cd-aa1f-3bcff3f50eb7 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:47:12.419198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:13.281073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1898644022", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:13.396058 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:47:13.397438 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:47:13.398116 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:47:13.400166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:47:13.401142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:47:13.424627 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.429890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.431938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:13.433080 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:13.434874 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:13.437364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:13.493573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Getting quotas for project 724e20d4dc92442793890056ba718eda. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:47:13.504138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Getting quotas for user f6d12ca5aa7b45dd8e7c1469040b3244 and project 724e20d4dc92442793890056ba718eda. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:47:13.523103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:47:13.526055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:47:13.705412 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-784a6048-28f0-4e8c-a7a6-313a8515764b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.294636 Nov 02 12:47:13.706835 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 882/1769] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:47:13.718220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:13.718994 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:13.721393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:13.722277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:13.840717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:13.852975 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:13.854793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:13.856212 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-77d8f5ea-d34a-4943-9012-16b01da8e2f6 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1278 microversion: 2.54 time: 0.142159 Nov 02 12:47:13.875111 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 888/1770] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:13 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:14.887607 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:14.888928 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:14.979204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.994828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.996391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:14.997930 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2edd8d1a-d281-4817-b688-4ea9695b1ed5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1278 microversion: 2.54 time: 0.116187 Nov 02 12:47:15.012530 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 883/1771] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:14 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1278 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:16.028958 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:16.032867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:16.059989 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:16.062353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:16.063197 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:16.067987 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:16.069989 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:16.071189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:16.345160 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:16.354441 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:16.355945 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:16.357192 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b5cc20de-71cc-46db-a0c0-e0e2ad8bddaa tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1282 microversion: 2.54 time: 0.335415 Nov 02 12:47:16.358484 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 889/1772] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:16 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1282 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:17.394481 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:17.397997 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:17.414350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:17.418626 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:17.419148 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:17.426713 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:17.427207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:17.446886 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:17.674204 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:17.686211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:17.688656 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:17.690311 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d33d49a2-e770-40a6-9698-dc0c360442da tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1330 microversion: 2.54 time: 0.304158 Nov 02 12:47:17.691425 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 884/1773] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:17 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1330 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:18.722629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:18.723767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:18.753701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:18.761564 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:18.762390 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.763379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:18.764067 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:18.764752 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:18.921596 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.940937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.940937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:18.942451 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c129cce5-196a-4b18-b6da-20e25af96b4c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1336 microversion: 2.54 time: 0.226926 Nov 02 12:47:18.945335 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 890/1774] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:18 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1336 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:19.618800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-925162959", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "43edb8cd-e88d-4cd5-92d7-49538830d418"}, {"uuid": "258c1d7d-00e1-4988-ad88-88f390a9c94a"}, {"uuid": "43edb8cd-e88d-4cd5-92d7-49538830d418"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:19.787896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] validate_networks() for [('43edb8cd-e88d-4cd5-92d7-49538830d418', None, None, None, None, None), ('258c1d7d-00e1-4988-ad88-88f390a9c94a', None, None, None, None, None), ('43edb8cd-e88d-4cd5-92d7-49538830d418', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:47:19.971193 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:19.971788 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:19.991240 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:19.999024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:19.999551 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.000393 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:20.006431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:20.015391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:20.211950 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.223083 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.225309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:20.226733 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-38992ca2-1873-4418-bbfd-2c5a09a908d3 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1336 microversion: 2.54 time: 0.259456 Nov 02 12:47:20.237385 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 891/1775] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:19 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1336 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea43fa15-2320-4cc6-822c-7d8534a00469) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:20.769578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea43fa15-2320-4cc6-822c-7d8534a00469) Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Request method failure captured: Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 304 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmbQvv03CnR0g1-RDdE9X2s3rhJ8ml5XJ-oOE9r3JpAYSgXiNtL7c8x8O7n7m3oG1e1D5yF20_n8pIxrFH_ni4r0fqAzEN0429xxqID4TXemexekUu2li-C5GFQy3iuJVTzebOHTjjfzki0zpWZExQsRwAWTI1cltCYcvwFGXxDkSjM Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 762ab703cd6b4d41ac9eddd7baa56c69 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_762ab703cd6b4d41ac9eddd7baa56c69", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/762ab703cd6b4d41ac9eddd7baa56c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/762ab703cd6b4d41ac9eddd7baa56c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/762ab703cd6b4d41ac9eddd7baa56c69"}]}] Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 762ab703cd6b4d41ac9eddd7baa56c69 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestMultiNic-681725672-project Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9d131de9b82a4c0692b6e33542361bda Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestMultiNic-681725672-project Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestMultiNic-server-925162959", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "43edb8cd-e88d-4cd5-92d7-49538830d418"}, {"uuid": "258c1d7d-00e1-4988-ad88-88f390a9c94a"}, {"uuid": "43edb8cd-e88d-4cd5-92d7-49538830d418"}]}} Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:20.776179 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-925162959', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '43edb8cd-e88d-4cd5-92d7-49538830d418'}, {'uuid': '258c1d7d-00e1-4988-ad88-88f390a9c94a'}, {'uuid': '43edb8cd-e88d-4cd5-92d7-49538830d418'}]}}} Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:20.792631 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ea43fa15-2320-4cc6-822c-7d8534a00469) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ad671001-1e81-456c-9aff-97ba99e9a4b2 tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.166534 Nov 02 12:47:20.796354 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 885/1776] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:47:19 2022] POST /compute/v2.1/servers => generated 214 bytes in 1171 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:47:21.254860 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:21.255484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:21.264118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:21.264118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:21.264293 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:21.267153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:21.267153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:21.267153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:21.567819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:21.594595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:21.596190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:21.597422 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e92515d4-9a26-49fc-a3a6-a6fc9492b957 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1336 microversion: 2.54 time: 0.346878 Nov 02 12:47:21.625345 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 892/1777] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:21 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1336 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:22.631554 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:22.633938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:22.657474 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.658613 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.660286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.663130 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:22.671134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:22.671134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:22.891198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.927509 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.942198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:22.944315 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ffd63c47-112a-499c-87b4-b8b5695c269f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1357 microversion: 2.54 time: 0.320257 Nov 02 12:47:22.948193 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 886/1778] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:22 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1357 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:22.976169 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-166f122e-85bd-4ce2-b51a-0b67e322dab8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Action: 'create', calling method: .version_select at 0x7eff5c214670>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-278157903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIACI4nVD1SfhbKYsuKLp6WX9DdW7qzRL0H3E0om8/a3YOPxYEn4rvE7BnDH41kD9bPutnpNA38sjZKr99u2UQ9r6k3R5D8oaYr10xehSMthTVbrMaTanETngkSnc4EW0w=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:23.005754 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-166f122e-85bd-4ce2-b51a-0b67e322dab8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Getting quotas for project 724e20d4dc92442793890056ba718eda. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:47:23.022449 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-166f122e-85bd-4ce2-b51a-0b67e322dab8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Getting quotas for user f6d12ca5aa7b45dd8e7c1469040b3244 and project 724e20d4dc92442793890056ba718eda. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:47:23.155340 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-166f122e-85bd-4ce2-b51a-0b67e322dab8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.176090 Nov 02 12:47:23.164064 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 893/1779] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:47:22 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:47:23.169278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-278157903", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:23.174599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:23.199585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.200364 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.201017 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.201921 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:23.207088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:23.207737 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:23.463728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:47:23.463728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:47:23.463728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:47:23.463728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:47:23.463728 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:47:23.475791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:24.230488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:24.255088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.256680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.260729 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.261901 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.264249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.266134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.367749 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27950b36-f9ff-40da-839a-b8f632427553 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "POST /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1/action" status: 202 len: 1139 microversion: 2.54 time: 1.202138 Nov 02 12:47:24.371258 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 887/1780] 10.222.0.64 () {62 vars in 1320 bytes} [Wed Nov 2 12:47:23 2022] POST /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1/action => generated 1139 bytes in 1207 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Nov 02 12:47:24.414336 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:24.416371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:24.431524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.432865 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.434263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.435988 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:24.437075 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:24.438257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:24.619363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.635279 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.637894 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:24.638051 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-79c65ce9-aa3c-40ba-8b9b-6f17dc691379 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.234333 Nov 02 12:47:24.638551 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 894/1781] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:24 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:25.668375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:25.669184 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:25.672290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:25.705486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.705486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.705486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:25.713875 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:25.716140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:25.717596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:26.001413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:26.016064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:26.019870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:26.022511 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bbca0f57-5c36-4064-b95a-71345b5391cb tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.359001 Nov 02 12:47:26.039401 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 888/1782] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:25 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:27.055379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:27.056722 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:27.066012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:27.067073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:27.067790 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:27.069327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:27.070057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:27.070718 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:27.270217 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.293292 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.300978 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:27.303094 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e1027898-f7ee-426f-9672-26b7cc6fc7c9 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.252845 Nov 02 12:47:27.316653 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 895/1783] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:27 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:28.346027 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:28.350144 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:28.367225 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.367983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.368945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.369777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:28.370142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:28.370570 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:28.516854 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:28.529953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:28.531567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:28.533691 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4fe7c2c1-0f0a-4e3c-a895-2aa0bdb87984 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.199094 Nov 02 12:47:28.534228 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 889/1784] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:28 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:29.563080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:29.564436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:29.577007 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:29.578371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:29.579528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:29.580844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:29.582050 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:29.583363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:29.732506 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:29.759644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:29.765450 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:29.769855 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-940f4192-6d3a-47db-bd35-93f8a669c7e8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.213100 Nov 02 12:47:29.773592 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 896/1785] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:29 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:30.807599 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:30.812314 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:30.838369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:30.839524 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:30.840212 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:30.841646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:30.842358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:30.843341 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:31.266969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:31.290190 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:31.293495 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:31.298204 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a73a190c-e479-4c79-9377-2ce7f8a255d5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.501456 Nov 02 12:47:31.300333 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 890/1786] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:30 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:32.336946 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:32.336946 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:32.343675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.344178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.344649 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:32.345370 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:32.345849 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:32.346238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:32.577828 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.598101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.599670 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:32.600997 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-84246968-5c52-40ad-88ab-5f9eed2d6f08 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.274063 Nov 02 12:47:32.612899 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 897/1787] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:32 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:33.633572 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:33.635678 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:33.643279 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.644023 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.644851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.645841 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:33.646642 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:33.647234 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:33.862310 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:33.877753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:33.883367 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:33.886443 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-47f7a1e9-8a69-4326-aef9-a6c7314f9d83 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.259252 Nov 02 12:47:33.892330 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 891/1788] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:33 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:34.922665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:34.923302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:34.925530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:34.973197 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.973734 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.974225 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:34.977887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:34.978379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:34.978818 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:35.241627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.255356 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.257175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:35.262376 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e48fe7f2-f9ef-4cd5-a253-e3edc25bbd6b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.343648 Nov 02 12:47:35.264629 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 898/1789] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:34 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:36.266953 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-293216978", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5c8f99fc-7303-4598-84f0-55aaf2d71c73"}, {"uuid": "3c698dd0-2fa3-4d6e-b20e-a8848beabdcd"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:36.289997 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:36.290917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:36.303037 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.318756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.321485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:36.323147 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:36.326145 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:36.326811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:36.427160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] validate_networks() for [('5c8f99fc-7303-4598-84f0-55aaf2d71c73', None, None, None, None, None), ('3c698dd0-2fa3-4d6e-b20e-a8848beabdcd', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:47:36.771664 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:36.784222 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:36.836250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:36.850938 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ad658c4d-b135-46a3-bdf2-7a61613e2a46 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.563571 Nov 02 12:47:36.852793 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 899/1790] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:36 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b57338-3b13-4c85-b5b4-d78da5b00beb) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:37.617300 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b57338-3b13-4c85-b5b4-d78da5b00beb) Nov 02 12:47:37.621701 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.624631 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:37.624631 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Request method failure captured: Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 254 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmbQvv03CnR0g1-RDdE9X2s3rhJ8ml5XJ-oOE9r3JpAYSgXiNtL7c8x8O7n7m3oG1e1D5yF20_n8pIxrFH_ni4r0fqAzEN0429xxqID4TXemexekUu2li-C5GFQy3iuJVTzebOHTjjfzki0zpWZExQsRwAWTI1cltCYcvwFGXxDkSjM Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 762ab703cd6b4d41ac9eddd7baa56c69 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_762ab703cd6b4d41ac9eddd7baa56c69", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/762ab703cd6b4d41ac9eddd7baa56c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/762ab703cd6b4d41ac9eddd7baa56c69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/762ab703cd6b4d41ac9eddd7baa56c69"}]}] Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 762ab703cd6b4d41ac9eddd7baa56c69 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestMultiNic-681725672 Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestMultiNic-681725672-project Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 9d131de9b82a4c0692b6e33542361bda Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestMultiNic-681725672-project Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestMultiNic-server-293216978", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5c8f99fc-7303-4598-84f0-55aaf2d71c73"}, {"uuid": "3c698dd0-2fa3-4d6e-b20e-a8848beabdcd"}]}} Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestMultiNic-server-293216978', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '5c8f99fc-7303-4598-84f0-55aaf2d71c73'}, {'uuid': '3c698dd0-2fa3-4d6e-b20e-a8848beabdcd'}]}}} Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:37.627639 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72b57338-3b13-4c85-b5b4-d78da5b00beb) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:47:37.631779 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:47:37.639684 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3748117a-a6a4-400c-946f-fea539dd877f tempest-ServersTestMultiNic-681725672 tempest-ServersTestMultiNic-681725672-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.366563 Nov 02 12:47:37.642299 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 892/1791] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:47:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1380 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:47:37.882976 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:37.884514 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:37.901615 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.917301 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.918396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:37.920737 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:37.926625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:37.928411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:38.760811 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.777408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.781213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:38.783196 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1b42d979-067d-4cf6-904d-f28704a09d7f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.905104 Nov 02 12:47:38.784317 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 900/1792] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:37 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:39.811480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:39.812250 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:39.821884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.828732 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.829416 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.832448 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:39.835199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:39.836837 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:39.944878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-32fd4976-221f-4ba1-aec6-a4dcd530202e tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Action: 'create', calling method: .version_select at 0x7eff5c131ca0>, body: {"keypair": {"name": "tempest-keypair-726589970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXZhwetccPdOuottXAbpuuke4lcfT907BclldaJmNjXGi6FbwAbYrh+OZEXUlVKDuM/ZMXRRs24hkFunM3bJfpy8J7Vq5MB8pdkrgQEBpvhFMhymf3j68maq9d2sOxyfw=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:40.016825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-32fd4976-221f-4ba1-aec6-a4dcd530202e tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Getting quotas for project 6a0d6178bceb4821a849a10833c56365. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:47:40.047549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-32fd4976-221f-4ba1-aec6-a4dcd530202e tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Getting quotas for user 60865b371ff044b79a4db130399b639f and project 6a0d6178bceb4821a849a10833c56365. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:47:40.257247 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-32fd4976-221f-4ba1-aec6-a4dcd530202e tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.824254 Nov 02 12:47:40.258184 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 893/1793] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:47:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:40.338363 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:40.358468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:40.360954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:40.370342 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-223ed597-659f-4079-889e-0e490b7f7f3f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.562804 Nov 02 12:47:40.371365 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 901/1794] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:39 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:41.411072 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:41.412391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:41.425722 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:41.426587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:41.427638 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:41.428930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:41.429657 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:41.431057 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:41.806844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.816589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.817134 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:41.818949 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b9e8c770-84bc-4a07-870c-b5ea55470f79 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.412373 Nov 02 12:47:41.834477 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 894/1795] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:41 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:42.851915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:42.851915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:42.861492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.861492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.861764 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:42.862427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:42.864629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:42.865420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:43.244427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.257891 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.259408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:43.264176 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8e15c2c7-a072-4f7f-af99-f07e12c4eb51 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.420074 Nov 02 12:47:43.265142 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 902/1796] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:42 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:44.294647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:44.296330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:44.307982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.310012 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.312829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.315369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:44.315369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:44.318809 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:44.550776 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:44.566423 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:44.568772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:44.570201 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-82ed6bc5-4d79-4b37-911c-9b6715755918 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.281051 Nov 02 12:47:44.571419 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 895/1797] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:44 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:45.609559 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:45.612862 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:45.637750 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:45.642701 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:45.644756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:45.645522 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:45.667892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:45.669040 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:45.841702 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.858823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.861737 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:45.863316 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-362ee44f-02b4-486c-8b1c-dc92c85d8317 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.266996 Nov 02 12:47:45.864122 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 903/1798] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:45 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:46.894583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:46.895788 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:46.899421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:46.905301 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.923321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.924838 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:46.934264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:46.934264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:46.934264 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:47.087392 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.097328 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.100687 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:47.102312 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ceb63937-e17b-4b5d-b381-dece77ea15f7 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.215417 Nov 02 12:47:47.103143 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 896/1799] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:46 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:48.132748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:48.134044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:48.152130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.152669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.157220 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.159534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:48.160205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:48.162328 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:48.438394 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:48.451322 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:48.455954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:48.462163 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ef40dfd6-7713-45ac-ac40-885de47360e4 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.334327 Nov 02 12:47:48.463409 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 904/1800] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:48 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:48.937768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1324551763", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4b614b6-864d-40a5-85b9-d9b8af92db1b"}], "security_groups": [{"name": "tempest-securitygroup--322245096"}], "key_name": "tempest-keypair-726589970", "user_data": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:47:49.316334 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] validate_networks() for [('c4b614b6-864d-40a5-85b9-d9b8af92db1b', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:47:49.493524 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:49.494318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:49.541329 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:49.544300 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.548512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.549284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.550310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:49.561267 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:49.562095 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:49.708633 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.720308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.724914 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:49.726160 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-33e706a4-8cdf-4468-8848-a0036cb76a38 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.237038 Nov 02 12:47:49.728356 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 905/1801] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:49 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:47:50.078342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5548f4c6-2262-4605-9ce1-46a869525036) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:50.279600 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5548f4c6-2262-4605-9ce1-46a869525036) Nov 02 12:47:50.283516 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.285624 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:50.285624 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Request method failure captured: Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 492 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmbrNaVAz8uJ94Od4LxWkErKq00Ax3yx3oextBveUjgOIeYP949xsgLfriAHdr8gA75k1ciZUM0Pu4JM_bM2buD_vNkcsIPEHxiLZnScZoM9zO0nTUUJnCiti6c-SvJHR0KnPqmzHNMm_HqitDPgYFP7TB3lWeEnm46ufDGLocw6R_M Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6a0d6178bceb4821a849a10833c56365 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerActionsTestJSON-223899355 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a0d6178bceb4821a849a10833c56365", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a0d6178bceb4821a849a10833c56365"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a0d6178bceb4821a849a10833c56365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a0d6178bceb4821a849a10833c56365"}]}] Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerActionsTestJSON-223899355 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6a0d6178bceb4821a849a10833c56365 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerActionsTestJSON-223899355 Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerActionsTestJSON-223899355-project Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 60865b371ff044b79a4db130399b639f Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerActionsTestJSON-223899355-project Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerActionsTestJSON-server-1324551763", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "J7@2K9MW_&dA^o*", "networks": [{"uuid": "c4b614b6-864d-40a5-85b9-d9b8af92db1b"}], "security_groups": [{"name": "tempest-securitygroup--322245096"}], "key_name": "tempest-keypair-726589970", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-1324551763', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'J7@2K9MW_&dA^o*', 'networks': [{'uuid': 'c4b614b6-864d-40a5-85b9-d9b8af92db1b'}], 'security_groups': [{'name': 'tempest-securitygroup--322245096'}], 'key_name': 'tempest-keypair-726589970', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:47:50.288695 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-5548f4c6-2262-4605-9ce1-46a869525036) Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:50.303494 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c281d956-5327-4715-8880-d9294a72e784 tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.359385 Nov 02 12:47:50.306715 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 897/1802] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:47:48 2022] POST /compute/v2.1/servers => generated 214 bytes in 1363 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:47:50.311033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ef49dab-0483-45b6-a1f8-3ee36436bada tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] Calling method '.version_select at 0x7eff5c1c0ee0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:50.434493 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8ef49dab-0483-45b6-a1f8-3ee36436bada tempest-ServerActionsTestJSON-223899355 tempest-ServerActionsTestJSON-223899355-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726589970" status: 202 len: 0 microversion: 2.1 time: 0.127811 Nov 02 12:47:50.435101 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 906/1803] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Nov 2 12:47:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726589970 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:47:50.758400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:50.759018 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:50.792628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.793132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.793604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.796300 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:50.796975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:50.797256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:50.849823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:51.064945 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:51.076137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:51.078681 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:51.083408 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de5ec5ef-ee73-42a4-8ef7-75f43490ecaf tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.330106 Nov 02 12:47:51.084426 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 898/1804] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:50 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:52.111205 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:52.111820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:52.121601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:52.122134 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:52.122576 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:52.123302 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:52.123756 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:52.124180 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:52.144892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=97 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:47:52.303294 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.313333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.320135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:52.322913 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8ed179f7-5368-46d2-a198-4b97ad79ddab tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1408 microversion: 2.54 time: 0.215704 Nov 02 12:47:52.324388 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 907/1805] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:52 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:53.351556 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:53.352146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:53.360344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.360990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.361424 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.362119 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:53.362777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:53.363199 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:53.529192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:53.536607 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:53.538324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:53.539528 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c92c4d20-608d-4110-a388-6bf43dfffc3b tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1414 microversion: 2.54 time: 0.192584 Nov 02 12:47:53.540378 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 899/1806] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:53 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1414 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:54.567417 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:54.568881 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:54.576108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:54.576724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:54.577236 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:54.578477 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:54.579199 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:54.579646 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:54.654592 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.670105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.672518 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:54.674057 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3e2af3ca-76b3-46c3-9a10-fda92784478f tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1414 microversion: 2.54 time: 0.111328 Nov 02 12:47:54.675615 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 908/1807] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:54 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1414 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:55.718216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:55.719804 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:55.762183 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:55.860780 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:55.875286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:55.877304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:55.883328 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-64c65815-350e-4533-a73d-c69428cfbf29 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1399 microversion: 2.54 time: 0.167747 Nov 02 12:47:55.884079 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 900/1808] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:55 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1399 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:55.910144 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5bdca54a-5e4a-453c-a1c2-35280a0fc996 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '.version_select at 0x7eff5c38af70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:56.019102 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5bdca54a-5e4a-453c-a1c2-35280a0fc996 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-278157903" status: 204 len: 0 microversion: 2.54 time: 0.111901 Nov 02 12:47:56.032620 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 909/1809] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Nov 2 12:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-278157903 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:47:56.044424 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:56.045188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:56.053971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.054763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.055807 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.056924 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.057853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.058759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.117758 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:47:56.644361 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5859a7d0-cad5-43d0-9396-1fea3a68b87c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "DELETE /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 204 len: 0 microversion: 2.54 time: 0.606377 Nov 02 12:47:56.647074 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 901/1810] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:47:56 2022] DELETE /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:47:56.655397 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:56.656033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:56.676572 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.677876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.678353 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.679096 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:56.679767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:56.680202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:56.759117 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.798485 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.800091 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:56.801399 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-bc54d3c0-7785-4bff-9692-7d578ac80575 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1405 microversion: 2.54 time: 0.150231 Nov 02 12:47:56.802392 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 910/1811] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:56 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:57.831098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:57.832042 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:57.846518 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:57.847060 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:57.847503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:57.848243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:57.848763 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:57.849192 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.208983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:58.229930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:58.232143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:58.233852 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-68a60e12-322f-4539-9918-84ef891d13c8 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1405 microversion: 2.54 time: 0.409019 Nov 02 12:47:58.235139 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 902/1812] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:57 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:47:58.886389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Calling method '.version_select at 0x7eff5c6c43a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:58.889542 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.890369 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.890822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.928153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.928936 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.930825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.959890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:58.960657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:58.961265 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:58.968990 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-155e4051-6ff6-4c31-947b-31d53d59531e tempest-PortsAdminExtendedAttrsTestJSON-1850760461 tempest-PortsAdminExtendedAttrsTestJSON-1850760461-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.588504 Nov 02 12:47:58.985892 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 911/1813] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:47:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:47:59.263863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:47:59.265188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:47:59.273517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:59.275623 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:59.276289 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:59.278350 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:59.278981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:59.295855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:59.416151 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:47:59.416951 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:47:59.418743 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:47:59.419802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lazy-loading 'fault' on Instance uuid 81da9728-5f59-4601-ad1b-4f8792c621b1 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:47:59.661941 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.690618 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.711801 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f6d12ca5aa7b45dd8e7c1469040b3244', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724e20d4dc92442793890056ba718eda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:47:59.716875 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dd8e2d34-0c25-40fb-9f81-cb10c843cfc5 tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 200 len: 1410 microversion: 2.54 time: 0.456159 Nov 02 12:47:59.718190 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 903/1814] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:47:59 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 1410 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:00.772698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:00.773526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] [instance: 81da9728-5f59-4601-ad1b-4f8792c621b1] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:00.780306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.781492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.782036 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.783018 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:00.783589 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:00.784296 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:00.802719 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] HTTP exception thrown: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Request method failure captured: Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 HTTP/1.1 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmbPYd_skLDAGV-yW70ogVcn00Dp2cBPgqc7lIDviKW-u-eG5_xF3UixOja5nBvzcgmExW2F7htzDzaNOLnijFbmRO1xY-415yzu7TZLyPm0eYJtRyiykMl9OBHKF-3F9_juM3mxypwWklpRlBKY_dkzUtuBUjRp93E9MezJVoKm-ZQ Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.54 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 724e20d4dc92442793890056ba718eda Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerShowV254Test-1123551169 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_724e20d4dc92442793890056ba718eda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/724e20d4dc92442793890056ba718eda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/724e20d4dc92442793890056ba718eda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/724e20d4dc92442793890056ba718eda"}]}] Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerShowV254Test-1123551169 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 724e20d4dc92442793890056ba718eda Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerShowV254Test-1123551169 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerShowV254Test-1123551169-project Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: f6d12ca5aa7b45dd8e7c1469040b3244 Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerShowV254Test-1123551169-project Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '81da9728-5f59-4601-ad1b-4f8792c621b1'} Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:00.805269 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. Nov 02 12:48:00.812955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:00.844420 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] Returning 404 to user: Instance 81da9728-5f59-4601-ad1b-4f8792c621b1 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:00.845365 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-15c01f05-f7b8-4bff-84ed-219d37b87b3c tempest-ServerShowV254Test-1123551169 tempest-ServerShowV254Test-1123551169-project] 10.222.0.64 "GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1" status: 404 len: 111 microversion: 2.54 time: 0.078962 Nov 02 12:48:00.857298 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 912/1815] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:00 2022] GET /compute/v2.1/servers/81da9728-5f59-4601-ad1b-4f8792c621b1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:48:04.361242 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-739576805", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": "none"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:04.443215 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:48:04.443995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:48:04.444514 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:48:04.444936 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:48:04.445354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:48:04.464420 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.466222 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.467406 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:04.469193 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:04.472543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:04.473203 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:04.537154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Getting quotas for project fc93689736c14e8dbfd8d32885abdbb8. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:04.543561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Getting quotas for user da7f3b0109eb45148e88b3e7d5c2a833 and project fc93689736c14e8dbfd8d32885abdbb8. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:04.572244 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:48:04.579172 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:48:04.840745 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d0542127-bf09-43aa-89f6-2e0c199604e0 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.651526 Nov 02 12:48:04.844572 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 904/1816] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:48:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:48:04.854386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:04.855565 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:05.100249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-08d92768-5597-42af-9733-b399b7087f16 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Action: 'create', calling method: .version_select at 0x7eff6080caf0>, body: {"keypair": {"name": "tempest-keypair-301532987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbotiyuweanWVAD6fwGF8y9/mzPCcsV43KeTww6jeyEXSDn0v6h8DekOODQp327QphueSLvkk0h9x5k2jhNRHuwwg8emYqpMTec39JdpvNENY2mvU87XGKiFKnh0B3yUg=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:05.166273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-08d92768-5597-42af-9733-b399b7087f16 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Getting quotas for project 8f45f7b86c104af5a07c40034429278c. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:05.186508 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:05.193861 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-08d92768-5597-42af-9733-b399b7087f16 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Getting quotas for user e2be048b612348bc8645e2ff12890db6 and project 8f45f7b86c104af5a07c40034429278c. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:05.199585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:05.201251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:05.202719 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c4997520-8520-40e4-928b-f1ff628f00bf tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1280 microversion: 2.47 time: 0.352938 Nov 02 12:48:05.207671 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 913/1817] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:04 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1280 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:05.490358 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-08d92768-5597-42af-9733-b399b7087f16 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.394824 Nov 02 12:48:05.502437 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 905/1818] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:48:05 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 407 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 02 12:48:06.238917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:06.241190 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:06.535234 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.552745 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.554768 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:06.556710 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4a880507-babe-48d2-a7c1-884264991a31 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1280 microversion: 2.47 time: 0.322452 Nov 02 12:48:06.558884 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 914/1819] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:06 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1280 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:07.592899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:07.592899 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:07.607163 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.607983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.608701 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.609636 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:07.610413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:07.611201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:07.845052 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:07.862039 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:07.865845 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:07.868257 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dcd629a2-a834-4ca0-a0e3-970cb2eff7ad tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1284 microversion: 2.47 time: 0.284987 Nov 02 12:48:07.869472 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 906/1820] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:07 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:08.900310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:08.902620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:08.914468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.915235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.917109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:08.918130 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:08.919641 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:08.921198 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:09.193707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.217454 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.219334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:09.222033 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-820fd26f-0768-478d-847c-ee45541aec6e tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1332 microversion: 2.47 time: 0.326398 Nov 02 12:48:09.223148 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 915/1821] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:08 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1332 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:10.257505 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:10.258140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:10.279010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.280168 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.280815 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.281784 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:10.282412 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:10.283835 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:10.483999 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:10.504759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:10.510971 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:10.514432 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-45a4a78b-f5c9-467a-afa9-49421dd3914b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1338 microversion: 2.47 time: 0.261454 Nov 02 12:48:10.519616 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 907/1822] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:10 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1338 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:11.552270 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:11.553723 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:11.570912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.589094 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.590974 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:11.592165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:11.594418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:11.595935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:12.026355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:12.046911 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:12.048563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:12.049783 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b6f82029-b69a-4738-9941-280348600db3 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1338 microversion: 2.47 time: 0.502387 Nov 02 12:48:12.050416 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 916/1823] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:11 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1338 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:12.462968 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1573082692", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "51871001-9b9b-4e28-aa55-68271f815ee1"}, {"port": "e9189809-9a37-4342-923c-0225f24a5496", "tag": "port-1"}, {"port": "5248b9fc-7d33-47e7-88b2-a85e4e80d314", "tag": "port-2"}, {"uuid": "03214f9b-bbee-4e82-b80d-4b13b3b27499", "tag": "net-1"}, {"uuid": "03214f9b-bbee-4e82-b80d-4b13b3b27499"}, {"uuid": "1108e33c-4e36-4360-b055-f25c4edf6a41", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1108e33c-4e36-4360-b055-f25c4edf6a41", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1f4792b3-c12f-4ae5-a419-ce13b41a30e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9467d120-c3a3-459c-8408-25daade32d54", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b7ff3105-b5c5-4aef-b7e8-e2de285e8354", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1281261260"}], "key_name": "tempest-keypair-301532987", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:12.937680 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] validate_networks() for [('51871001-9b9b-4e28-aa55-68271f815ee1', None, None, None, None, None), (None, None, 'e9189809-9a37-4342-923c-0225f24a5496', None, None, None), (None, None, '5248b9fc-7d33-47e7-88b2-a85e4e80d314', None, None, None), ('03214f9b-bbee-4e82-b80d-4b13b3b27499', None, None, None, None, None), ('03214f9b-bbee-4e82-b80d-4b13b3b27499', None, None, None, None, None), ('1108e33c-4e36-4360-b055-f25c4edf6a41', '10.2.2.100', None, None, None, None), ('1108e33c-4e36-4360-b055-f25c4edf6a41', '10.2.2.200', None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:13.078153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:13.078792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:13.092631 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.094043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.094043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.097320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.097964 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.098638 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.416915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.428546 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.435621 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:13.443325 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b7efd0e7-1d7c-4aa4-8a1b-c335be2b37f8 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1359 microversion: 2.47 time: 0.364111 Nov 02 12:48:13.444344 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 917/1824] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:13 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1359 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:48:13.473770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1788951126"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:13.476173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:13.486463 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.491239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.491863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:13.498238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:13.499102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:13.499717 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:14.253813 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4788d02a-360c-46d8-a5c2-8597b238adbd tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "POST /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c/action" status: 202 len: 52 microversion: 2.47 time: 0.785690 Nov 02 12:48:14.256476 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 918/1825] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Nov 2 12:48:13 2022] POST /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c/action => generated 52 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Nov 02 12:48:14.502069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:14.671474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1598364558", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:14.763119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] validate_networks() for [('796ffcce-1550-4d20-a67b-b64932b09c24', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:15.220076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=10 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:15.318398 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb) Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Request method failure captured: Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 1344 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYma1dDCP9NaavHSDkCba3UJcu78Sq7gqrvDlvpn_FgbE2RJY3NEuFO_QcMl7NRjXTbf4A-jH2g9wSVKiNxtsEge5BYNssr5Fb1ibP5lPU0xXKFFFPDJlkKioOwVn9pyTGE0jFVxnNMrl6GiDDuXZGb5JEy2yzcIwXNMdnIjo6ogfJUE Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Openstack-Nova-Api-Version: 2.42 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8f45f7b86c104af5a07c40034429278c Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1892830254 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8f45f7b86c104af5a07c40034429278c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8f45f7b86c104af5a07c40034429278c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8f45f7b86c104af5a07c40034429278c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8f45f7b86c104af5a07c40034429278c"}]}] Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1892830254 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8f45f7b86c104af5a07c40034429278c Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1892830254 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TaggedBootDevicesTest_v242-1892830254-project Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: e2be048b612348bc8645e2ff12890db6 Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1892830254-project Nov 02 12:48:15.322496 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-device-tagging-server-1573082692", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "51871001-9b9b-4e28-aa55-68271f815ee1"}, {"port": "e9189809-9a37-4342-923c-0225f24a5496", "tag": "port-1"}, {"port": "5248b9fc-7d33-47e7-88b2-a85e4e80d314", "tag": "port-2"}, {"uuid": "03214f9b-bbee-4e82-b80d-4b13b3b27499", "tag": "net-1"}, {"uuid": "03214f9b-bbee-4e82-b80d-4b13b3b27499"}, {"uuid": "1108e33c-4e36-4360-b055-f25c4edf6a41", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1108e33c-4e36-4360-b055-f25c4edf6a41", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1f4792b3-c12f-4ae5-a419-ce13b41a30e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "9467d120-c3a3-459c-8408-25daade32d54", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b7ff3105-b5c5-4aef-b7e8-e2de285e8354", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1281261260"}], "key_name": "tempest-keypair-301532987", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-device-tagging-server-1573082692', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'config_drive': True, 'networks': [{'uuid': '51871001-9b9b-4e28-aa55-68271f815ee1'}, {'port': 'e9189809-9a37-4342-923c-0225f24a5496', 'tag': 'port-1'}, {'port': '5248b9fc-7d33-47e7-88b2-a85e4e80d314', 'tag': 'port-2'}, {'uuid': '03214f9b-bbee-4e82-b80d-4b13b3b27499', 'tag': 'net-1'}, {'uuid': '03214f9b-bbee-4e82-b80d-4b13b3b27499'}, {'uuid': '1108e33c-4e36-4360-b055-f25c4edf6a41', 'fixed_ip': '10.2.2.100', 'tag': 'net-2-100'}, {'uuid': '1108e33c-4e36-4360-b055-f25c4edf6a41', 'fixed_ip': '10.2.2.200', 'tag': 'net-2-200'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'tag': 'boot', 'volume_id': '1f4792b3-c12f-4ae5-a419-ce13b41a30e6', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 1, 'tag': 'other', 'volume_id': '9467d120-c3a3-459c-8408-25daade32d54', 'delete_on_termination': False}, {'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 2, 'volume_id': 'b7ff3105-b5c5-4aef-b7e8-e2de285e8354', 'delete_on_termination': False}], 'security_groups': [{'name': 'tempest-securitygroup--1281261260'}], 'key_name': 'tempest-keypair-301532987', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.333567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d7a1a2d-324c-4f7d-9a6e-59c7896759bb) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.335741 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4a5985b3-1fff-4b53-8f07-c69383ff2471 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.42 time: 2.865178 Nov 02 12:48:15.339299 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 908/1826] 10.222.0.64 () {62 vars in 1189 bytes} [Wed Nov 2 12:48:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 2866 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:48:15.341069 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:15.344781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:15.352983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.353715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.354316 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.355292 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.355972 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.356611 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.419738 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:48:15.797990 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ea617ba8-c7a7-43b9-ac85-fb02a92cff40 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 204 len: 0 microversion: 2.47 time: 0.467243 Nov 02 12:48:15.798775 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 909/1827] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Nov 2 12:48:15 2022] DELETE /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:48:15.805620 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9d083960-3677-473b-9cbf-6e4fd5527126 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] Calling method '.version_select at 0x7eff60843310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02093be2-f5a0-41ac-97c3-8d302a794135) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:15.826396 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02093be2-f5a0-41ac-97c3-8d302a794135) Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.830741 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Request method failure captured: Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 210 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmcNoH_UkMPUBKGRB4Xy5dvqJg1W9Lri29fZtHaHj3sZSeYGIOEi8YnrBsReYDZq3GTbAeTO9Krvyy0_ApnR7D-bJDwxtsAupW5nqRto1q7GXQ8Mp8nh5t2vnKyQGIiUVRXO6aJXFsXTqUYFIOI4ng8V0Aa9CXzNbqp1QSADMhy9GPI Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a720f4a1648e4aa1b4efaf39bb904f11", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}] Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 3ccf6b6cde274e6fbbda8f3c92808415 Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1598364558", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-1598364558', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '796ffcce-1550-4d20-a67b-b64932b09c24'}]}}} Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:15.835648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02093be2-f5a0-41ac-97c3-8d302a794135) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:15.853065 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9c50ee4a-308a-4616-ba55-2d2a0655faf8 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.580012 Nov 02 12:48:15.871114 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 919/1828] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1588 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:48:15.879395 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:15.882003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:15.890008 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.890746 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.891350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.894386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:15.896192 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:15.897029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:15.931546 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9d083960-3677-473b-9cbf-6e4fd5527126 tempest-TaggedBootDevicesTest_v242-1892830254 tempest-TaggedBootDevicesTest_v242-1892830254-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301532987" status: 204 len: 0 microversion: 2.42 time: 0.131384 Nov 02 12:48:15.932860 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 910/1829] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Nov 2 12:48:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301532987 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:48:16.131232 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-995199904", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:16.260686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] validate_networks() for [('796ffcce-1550-4d20-a67b-b64932b09c24', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:16.282968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:16.296538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:16.306128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:16.306128 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-efafe37f-6790-4596-bb14-d7ab9b83de75 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1365 microversion: 2.47 time: 0.433220 Nov 02 12:48:16.306128 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 920/1830] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:15 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:17.335104 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:17.336105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:17.340869 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:17.348436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.349962 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.359968 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:17.361107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:17.361845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:17.364124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e2d36293-59e7-4272-9499-45082de632f5) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:17.385686 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e2d36293-59e7-4272-9499-45082de632f5) Nov 02 12:48:17.389283 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.394393 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:17.394393 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Request method failure captured: Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 209 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmcNoH_UkMPUBKGRB4Xy5dvqJg1W9Lri29fZtHaHj3sZSeYGIOEi8YnrBsReYDZq3GTbAeTO9Krvyy0_ApnR7D-bJDwxtsAupW5nqRto1q7GXQ8Mp8nh5t2vnKyQGIiUVRXO6aJXFsXTqUYFIOI4ng8V0Aa9CXzNbqp1QSADMhy9GPI Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a720f4a1648e4aa1b4efaf39bb904f11", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}] Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 3ccf6b6cde274e6fbbda8f3c92808415 Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-995199904", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-995199904', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '796ffcce-1550-4d20-a67b-b64932b09c24'}]}}} Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:17.401643 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e2d36293-59e7-4272-9499-45082de632f5) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:17.406051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.418953 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:17.423830 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:17.423830 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:17.425331 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ee441420-d20d-4bde-8189-8854fc0a8447 tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.300569 Nov 02 12:48:17.431078 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 911/1831] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:16 2022] POST /compute/v2.1/servers => generated 214 bytes in 1307 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:48:17.610589 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-148986074", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:17.634770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.651883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.659571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:17.660148 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b5fd52a2-d753-4647-af27-36ae109eee15 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1365 microversion: 2.47 time: 0.331682 Nov 02 12:48:17.673649 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 921/1832] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:17 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1365 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:17.705866 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] validate_networks() for [('796ffcce-1550-4d20-a67b-b64932b09c24', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:18.691425 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:18.692647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:18.710422 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:18.710970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:18.711426 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:18.712166 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:18.712954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:18.713578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:18.876657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:18.897275 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:18.899105 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:18.901555 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-713ab623-1bf1-43b4-8a72-05f110ad5b4b tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1365 microversion: 2.47 time: 0.213417 Nov 02 12:48:18.912510 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 922/1833] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:18 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:18.973102 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e) Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Request method failure captured: Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 209 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmcNoH_UkMPUBKGRB4Xy5dvqJg1W9Lri29fZtHaHj3sZSeYGIOEi8YnrBsReYDZq3GTbAeTO9Krvyy0_ApnR7D-bJDwxtsAupW5nqRto1q7GXQ8Mp8nh5t2vnKyQGIiUVRXO6aJXFsXTqUYFIOI4ng8V0Aa9CXzNbqp1QSADMhy9GPI Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a720f4a1648e4aa1b4efaf39bb904f11", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a720f4a1648e4aa1b4efaf39bb904f11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a720f4a1648e4aa1b4efaf39bb904f11"}]}] Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a720f4a1648e4aa1b4efaf39bb904f11 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1219223035 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 3ccf6b6cde274e6fbbda8f3c92808415 Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerDiskConfigTestJSON-1219223035-project Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-148986074", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "796ffcce-1550-4d20-a67b-b64932b09c24"}]}} Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:18.979981 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-148986074', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '796ffcce-1550-4d20-a67b-b64932b09c24'}]}}} Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:18.983749 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3e2950b6-ce4a-4d0c-94ac-d87a643d482e) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b106271f-dea6-4853-958a-1446d8c337ca tempest-ServerDiskConfigTestJSON-1219223035 tempest-ServerDiskConfigTestJSON-1219223035-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.363253 Nov 02 12:48:18.987659 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 912/1834] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:17 2022] POST /compute/v2.1/servers => generated 214 bytes in 1366 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 12:48:19.931213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:19.931861 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:19.948045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.948571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.949549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:19.949699 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:19.950320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:19.950905 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.011143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:20.011606 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:20.012053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:20.018556 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lazy-loading 'fault' on Instance uuid 893dd855-ad62-4a1d-b81e-c261c37ee28c {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:48:20.124077 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:20.196168 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:20.204399 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'da7f3b0109eb45148e88b3e7d5c2a833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc93689736c14e8dbfd8d32885abdbb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:48:20.207413 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6ff7eb89-4643-4d06-aeb9-0e4f096aea47 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 200 len: 1370 microversion: 2.47 time: 0.280506 Nov 02 12:48:20.217395 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 923/1835] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:19 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 1370 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:48:21.256805 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:21.258221 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] [instance: 893dd855-ad62-4a1d-b81e-c261c37ee28c] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:48:21.264063 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:21.265938 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:21.266602 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:21.267208 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:21.268137 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:48:21.268798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:48:21.269414 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:48:21.284884 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] HTTP exception thrown: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Request method failure captured: Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c HTTP/1.1 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmcD-JXoTPGjs9o568jszz6IOrwNvgyn1M0T3IZ83mDGvqssou7wei9brlQZlHg6x1wni7eKaCIbJ251iCmIS2FE-QJD9hg1k6qM_SX5t_plOOb4iV2FzDY4TOmgFoAl1SMbHAVz_w3lcfP55e_7bwHdobEaKObN9Hkdid4e6lmXjsU Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Openstack-Nova-Api-Version: 2.47 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: fc93689736c14e8dbfd8d32885abdbb8 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAaction247Test-1814440787 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fc93689736c14e8dbfd8d32885abdbb8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fc93689736c14e8dbfd8d32885abdbb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fc93689736c14e8dbfd8d32885abdbb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fc93689736c14e8dbfd8d32885abdbb8"}]}] Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAaction247Test-1814440787 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: fc93689736c14e8dbfd8d32885abdbb8 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAaction247Test-1814440787 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAaction247Test-1814440787-project Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: da7f3b0109eb45148e88b3e7d5c2a833 Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAaction247Test-1814440787-project Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '893dd855-ad62-4a1d-b81e-c261c37ee28c'} Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:21.286752 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. Nov 02 12:48:21.290940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:21.292967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] Returning 404 to user: Instance 893dd855-ad62-4a1d-b81e-c261c37ee28c could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:21.301056 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4db9b99e-3cf8-4c7a-9f97-b0d228e07e22 tempest-ServersAaction247Test-1814440787 tempest-ServersAaction247Test-1814440787-project] 10.222.0.64 "GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c" status: 404 len: 111 microversion: 2.47 time: 0.043959 Nov 02 12:48:21.301056 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 913/1836] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Nov 2 12:48:21 2022] GET /compute/v2.1/servers/893dd855-ad62-4a1d-b81e-c261c37ee28c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:48:27.407475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-185e34b0-7eaf-4524-a3af-40f05e72eed7 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: .version_select at 0x7eff5c38a0d0>, body: {"keypair": {"name": "tempest-keypair-2033084977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvMWOz7u4iM2YCrh0BlfSiqZz7p+cdbyJsWiMYSZTQj4iA0syefDkfCqYGwcY40eQ9CWXKWF2LQMXjNRtyQ6j+yPwMdFiB0fst4HqlZ8ZUCtBh/T6C6DzJHg4PsbhzVnw=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:27.415913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:27.448221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-185e34b0-7eaf-4524-a3af-40f05e72eed7 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:27.457498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-185e34b0-7eaf-4524-a3af-40f05e72eed7 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for user c97d1f9cf2384ad7baf02cfd017430d2 and project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:27.667834 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-185e34b0-7eaf-4524-a3af-40f05e72eed7 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.550550 Nov 02 12:48:27.667834 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 924/1837] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:48:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:48:33.851187 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-273859605", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1056215886"}], "key_name": "tempest-keypair-2033084977", "user_data": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:33.876082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:34.236088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] validate_networks() for [('ad45f526-3e4b-4f7a-8784-0986fb0ae1e6', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ac92199-d9ec-46cf-8991-4a13afb29bd9) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:35.531208 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ac92199-d9ec-46cf-8991-4a13afb29bd9) Nov 02 12:48:35.535994 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.551000 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:35.551000 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Request method failure captured: Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 489 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmcZ8IXwz_w4VKdPKZ6VO_js3QO7YpKg2560JlS3tv41SIfg9hpQ2ooTzKg3poiMUF-FNcHaxCLZOdy_y2OG9YXtaAUPfwfgR-J4cVqCCVXgLzKqdy6l3r9eWvark0gma3VteukRj0w4N14Iot9sLdInIO1LUcMFWBcTWdr5likfdGo Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_50dbedb7dffd4f67adfc30507afc0b98", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}] Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: c97d1f9cf2384ad7baf02cfd017430d2 Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-273859605", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1056215886"}], "key_name": "tempest-keypair-2033084977", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-273859605', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'ad45f526-3e4b-4f7a-8784-0986fb0ae1e6'}], 'security_groups': [{'name': 'tempest-securitygroup--1056215886'}], 'key_name': 'tempest-keypair-2033084977', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:35.560098 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9ac92199-d9ec-46cf-8991-4a13afb29bd9) Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:35.570069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de987787-8886-4de8-9870-64dfb7ae863f tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.726502 Nov 02 12:48:35.582263 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 914/1838] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:33 2022] POST /compute/v2.1/servers => generated 214 bytes in 1732 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:48:35.596685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3dc9ce9a-fc98-4fd3-a6b8-83aa154370bf tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Calling method '.version_select at 0x7eff5dde8af0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:35.602238 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:35.788379 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3dc9ce9a-fc98-4fd3-a6b8-83aa154370bf tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2033084977" status: 202 len: 0 microversion: 2.1 time: 0.196252 Nov 02 12:48:35.789330 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 925/1839] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2033084977 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:39.172258 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a5ebcf6e-b2a6-4515-a325-e9897c76a7d2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: .version_select at 0x7eff60827ca0>, body: {"keypair": {"name": "tempest-keypair-1085219902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPv1BYOO1qxx7Wad65WcuGQOVNd31RbmBdfduLlm1L5/twEXaFk7fLoiCr354KZpMyewthOkOAGe8tKt1rguPrV4NsY8UiHMYHQTTVi//1x+oetn9r9mxor1WI3yWBmeDQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:39.202894 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a5ebcf6e-b2a6-4515-a325-e9897c76a7d2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:39.212014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-a5ebcf6e-b2a6-4515-a325-e9897c76a7d2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for user c97d1f9cf2384ad7baf02cfd017430d2 and project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:39.343211 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a5ebcf6e-b2a6-4515-a325-e9897c76a7d2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177937 Nov 02 12:48:39.350416 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 915/1840] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:48:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:43.765707 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:44.011113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1743360579", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "abb29b2e-8178-4c9c-8d6c-ea100e03d6d8"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:44.172601 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] validate_networks() for [('abb29b2e-8178-4c9c-8d6c-ea100e03d6d8', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7def3d45-ae35-4de8-8ffb-3b481b420282) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:44.601866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7def3d45-ae35-4de8-8ffb-3b481b420282) Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:44.606130 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] Request method failure captured: Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 209 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmcrt4i47Rm0x2B49_T9AAqMvXKEG7j9mF0430FXIKDQDisx2Yozx3hd9cRWszu0rNvWHZYRpcIG--bBbFOefQwX2g-19GiKXEacOuhGuwb3mpYNsnxSRxQGrRGNrvDo5uQgdENf31wPDsXoMlvhBkJKndaIm9jZNhpUVASTr3yPVyg Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 952e3a77e8784db5b41f326d932f78b4 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerAddressesTestJSON-1774826007 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_952e3a77e8784db5b41f326d932f78b4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/952e3a77e8784db5b41f326d932f78b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/952e3a77e8784db5b41f326d932f78b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/952e3a77e8784db5b41f326d932f78b4"}]}] Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerAddressesTestJSON-1774826007 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 952e3a77e8784db5b41f326d932f78b4 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1774826007 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerAddressesTestJSON-1774826007-project Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8e2db6eb17204446a1b19e4c60c2dfa5 Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerAddressesTestJSON-1774826007-project Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1743360579", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "abb29b2e-8178-4c9c-8d6c-ea100e03d6d8"}]}} Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerAddressesTestJSON-server-1743360579', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'abb29b2e-8178-4c9c-8d6c-ea100e03d6d8'}]}}} Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:44.607819 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7def3d45-ae35-4de8-8ffb-3b481b420282) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:44.613210 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2db9770b-7859-4d98-8412-1e0ea8031f4f tempest-ServerAddressesTestJSON-1774826007 tempest-ServerAddressesTestJSON-1774826007-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.844787 Nov 02 12:48:44.617547 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 926/1841] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 852 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:48:46.650527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1631434927", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1174923898"}], "key_name": "tempest-keypair-1085219902", "user_data": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:46.853260 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] validate_networks() for [('ad45f526-3e4b-4f7a-8784-0986fb0ae1e6', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462aa479-be8a-4b53-9696-d6013e251fd6) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:47.448607 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462aa479-be8a-4b53-9696-d6013e251fd6) Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:47.452006 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Request method failure captured: Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 490 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmcZ8IXwz_w4VKdPKZ6VO_js3QO7YpKg2560JlS3tv41SIfg9hpQ2ooTzKg3poiMUF-FNcHaxCLZOdy_y2OG9YXtaAUPfwfgR-J4cVqCCVXgLzKqdy6l3r9eWvark0gma3VteukRj0w4N14Iot9sLdInIO1LUcMFWBcTWdr5likfdGo Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_50dbedb7dffd4f67adfc30507afc0b98", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}] Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: c97d1f9cf2384ad7baf02cfd017430d2 Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1631434927", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1174923898"}], "key_name": "tempest-keypair-1085219902", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-1631434927', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'ad45f526-3e4b-4f7a-8784-0986fb0ae1e6'}], 'security_groups': [{'name': 'tempest-securitygroup--1174923898'}], 'key_name': 'tempest-keypair-1085219902', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:48:47.453457 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-462aa479-be8a-4b53-9696-d6013e251fd6) Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:47.459071 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:48:47.469996 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4b15d766-8241-4957-bea7-046a80a537b2 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.813776 Nov 02 12:48:47.471484 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6dde636a-9d8d-4deb-916b-45ad1324d96b tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Calling method '.version_select at 0x7eff5ce47dc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:48:47.480972 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 916/1842] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 840 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:48:47.592042 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6dde636a-9d8d-4deb-916b-45ad1324d96b tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085219902" status: 202 len: 0 microversion: 2.1 time: 0.129135 Nov 02 12:48:47.592997 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 927/1843] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1085219902 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:48:51.170641 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:51.175604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b2285ef5-d333-4e1f-9763-ccbefc50033a tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: .version_select at 0x7eff5d266ca0>, body: {"keypair": {"name": "tempest-keypair-1534869317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfja5lWx5HYwlXW5Q68ciRNl72hCsBKHbk8XPRcDW89z+QwN1UmfiqDzX4Ir4fMjNwGd3CfvfBK4pDtRdIVX3PeSMi1KiRUEHK5UaXNfY8xDoP2e+CHOCP7+gocpS3X1Q=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:51.214223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b2285ef5-d333-4e1f-9763-ccbefc50033a tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:48:51.228644 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b2285ef5-d333-4e1f-9763-ccbefc50033a tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Getting quotas for user c97d1f9cf2384ad7baf02cfd017430d2 and project 50dbedb7dffd4f67adfc30507afc0b98. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:48:51.385837 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b2285ef5-d333-4e1f-9763-ccbefc50033a tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.216342 Nov 02 12:48:51.386866 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 917/1844] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:48:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:48:59.174688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:48:59.512013 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-2075914658", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f8033aa9-87c0-479a-b95f-16fb9f7b8969"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:48:59.608825 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] validate_networks() for [('f8033aa9-87c0-479a-b95f-16fb9f7b8969', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0baa320f-465f-4219-baaf-00dc409673bb) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:00.477120 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0baa320f-465f-4219-baaf-00dc409673bb) Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Request method failure captured: Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 226 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmc6q7JWFZVj0Hj379KHoMYt3GJ4s2YcaqN_0C8ZcemgeM0avdCgxN1l8IARwv9jKicbJcd5vXxMAry8FeDEmHw0sY97FviLlRaN4D0VK8syLJjE2UYfSdWQ0rhHaKEVKdMSysWmxEbM_4si_o7-o4EvPolFYSM51BvY5PRgIu9assA Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 4397600a6e7f4af4ab461b1b30f5b750 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4397600a6e7f4af4ab461b1b30f5b750", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4397600a6e7f4af4ab461b1b30f5b750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4397600a6e7f4af4ab461b1b30f5b750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4397600a6e7f4af4ab461b1b30f5b750"}]}] Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 4397600a6e7f4af4ab461b1b30f5b750 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-MultipleCreateTestJSON-301647604-project Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: dfba39e9f7574d87b644341c52476e4d Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-MultipleCreateTestJSON-301647604-project Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-tempest.common.compute-instance-2075914658", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f8033aa9-87c0-479a-b95f-16fb9f7b8969"}]}} Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-tempest.common.compute-instance-2075914658', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 2, 'networks': [{'uuid': 'f8033aa9-87c0-479a-b95f-16fb9f7b8969'}]}}} Nov 02 12:49:00.483428 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:00.491867 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-0baa320f-465f-4219-baaf-00dc409673bb) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5975d237-20bf-4570-979c-952616bde424 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.309883 Nov 02 12:49:00.497005 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 928/1845] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:48:59 2022] POST /compute/v2.1/servers => generated 214 bytes in 1315 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:49:00.767604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1687210522", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f8033aa9-87c0-479a-b95f-16fb9f7b8969"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:00.949587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] validate_networks() for [('f8033aa9-87c0-479a-b95f-16fb9f7b8969', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e44d40f3-e21a-42f3-9d69-b2f1705f252d) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:02.225573 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e44d40f3-e21a-42f3-9d69-b2f1705f252d) Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:02.230184 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Request method failure captured: Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 271 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmc6q7JWFZVj0Hj379KHoMYt3GJ4s2YcaqN_0C8ZcemgeM0avdCgxN1l8IARwv9jKicbJcd5vXxMAry8FeDEmHw0sY97FviLlRaN4D0VK8syLJjE2UYfSdWQ0rhHaKEVKdMSysWmxEbM_4si_o7-o4EvPolFYSM51BvY5PRgIu9assA Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 4397600a6e7f4af4ab461b1b30f5b750 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4397600a6e7f4af4ab461b1b30f5b750", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4397600a6e7f4af4ab461b1b30f5b750"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4397600a6e7f4af4ab461b1b30f5b750"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4397600a6e7f4af4ab461b1b30f5b750"}]}] Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 4397600a6e7f4af4ab461b1b30f5b750 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-MultipleCreateTestJSON-301647604 Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-MultipleCreateTestJSON-301647604-project Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: dfba39e9f7574d87b644341c52476e4d Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-MultipleCreateTestJSON-301647604-project Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1687210522", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f8033aa9-87c0-479a-b95f-16fb9f7b8969"}]}} Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateTestJSON-server-1687210522', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'min_count': 1, 'max_count': 2, 'return_reservation_id': True, 'networks': [{'uuid': 'f8033aa9-87c0-479a-b95f-16fb9f7b8969'}]}}} Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:02.233037 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e44d40f3-e21a-42f3-9d69-b2f1705f252d) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:02.237062 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:02.246175 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6ede25df-0720-4085-a7c1-4e5c3549dbd4 tempest-MultipleCreateTestJSON-301647604 tempest-MultipleCreateTestJSON-301647604-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.476180 Nov 02 12:49:02.249934 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 918/1846] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:49:00 2022] POST /compute/v2.1/servers => generated 214 bytes in 1488 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:49:02.568070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-498282475", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1995535884"}], "key_name": "tempest-keypair-1534869317", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:03.075890 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] validate_networks() for [('ad45f526-3e4b-4f7a-8784-0986fb0ae1e6', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4851f4f7-a822-4d5a-84ef-13f57782c9f3) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:04.247060 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4851f4f7-a822-4d5a-84ef-13f57782c9f3) Nov 02 12:49:04.251390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.256721 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:04.256721 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Request method failure captured: Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 489 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmcZ8IXwz_w4VKdPKZ6VO_js3QO7YpKg2560JlS3tv41SIfg9hpQ2ooTzKg3poiMUF-FNcHaxCLZOdy_y2OG9YXtaAUPfwfgR-J4cVqCCVXgLzKqdy6l3r9eWvark0gma3VteukRj0w4N14Iot9sLdInIO1LUcMFWBcTWdr5likfdGo Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_50dbedb7dffd4f67adfc30507afc0b98", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/50dbedb7dffd4f67adfc30507afc0b98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/50dbedb7dffd4f67adfc30507afc0b98"}]}] Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 50dbedb7dffd4f67adfc30507afc0b98 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1683431703 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: c97d1f9cf2384ad7baf02cfd017430d2 Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AttachVolumeNegativeTest-1683431703-project Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-498282475", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "ad45f526-3e4b-4f7a-8784-0986fb0ae1e6"}], "security_groups": [{"name": "tempest-securitygroup--1995535884"}], "key_name": "tempest-keypair-1534869317", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeNegativeTest-server-498282475', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': 'ad45f526-3e4b-4f7a-8784-0986fb0ae1e6'}], 'security_groups': [{'name': 'tempest-securitygroup--1995535884'}], 'key_name': 'tempest-keypair-1534869317', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:04.257895 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4851f4f7-a822-4d5a-84ef-13f57782c9f3) Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.263158 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7584f8f4-5e35-4ae2-996b-1a24d7b63f73 tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.697850 Nov 02 12:49:04.271671 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 929/1847] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:49:02 2022] POST /compute/v2.1/servers => generated 214 bytes in 1699 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:49:04.275313 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-bb943ddf-e288-4065-90dc-6d44dc24d06e tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] Calling method '.version_select at 0x7eff60808670>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:04.457140 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-bb943ddf-e288-4065-90dc-6d44dc24d06e tempest-AttachVolumeNegativeTest-1683431703 tempest-AttachVolumeNegativeTest-1683431703-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534869317" status: 202 len: 0 microversion: 2.1 time: 0.188653 Nov 02 12:49:04.460841 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 919/1848] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 12:49:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534869317 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:49:14.493896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:14.839334 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Calling method '.version_select at 0x7eff5c3a3820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:14.841760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:14.842177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:14.842629 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:14.873986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:14.880999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:14.880999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:14.906401 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:49:14.906907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:49:14.907350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:49:14.918390 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fb8f102d-d0e9-4429-a1fc-d427988777df tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1650937422-project-admin] 10.222.0.64 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.425423 Nov 02 12:49:14.921556 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 930/1849] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 12:49:14 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:49:20.473207 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:20.474309 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:21.179581 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Action: 'create', calling method: .version_select at 0x7eff5cbf0670>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:21.228082 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Getting quotas for project 55a4471c28cb45818f388321acb74608. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:49:21.251806 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Getting quotas for user 2797455f7ef140948189fab55f654585 and project 55a4471c28cb45818f388321acb74608. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:49:21.551347 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Getting quotas for project 55a4471c28cb45818f388321acb74608. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:49:21.565127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Getting quotas for user 2797455f7ef140948189fab55f654585 and project 55a4471c28cb45818f388321acb74608. Resources: {'server_groups'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:49:21.587446 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-25855556-2579-4e5a-a08e-bcbe438ccefb tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] 10.222.0.64 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 1.120548 Nov 02 12:49:21.591435 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 920/1850] 10.222.0.64 () {62 vars in 1214 bytes} [Wed Nov 2 12:49:20 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:49:21.599494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5016c747-293a-4584-b44c-434aa8651d65 tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:21.623722 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5016c747-293a-4584-b44c-434aa8651d65 tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.028525 Nov 02 12:49:21.626504 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 931/1851] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Nov 2 12:49:21 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:49:21.636823 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f90eb19c-0384-4b23-8515-fd369f80cfe7 tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:21.650931 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f90eb19c-0384-4b23-8515-fd369f80cfe7 tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] 10.222.0.64 "GET /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2" status: 200 len: 235 microversion: 2.64 time: 0.018077 Nov 02 12:49:21.653248 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 921/1852] 10.222.0.64 () {60 vars in 1304 bytes} [Wed Nov 2 12:49:21 2022] GET /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2 => generated 235 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:49:21.664838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a0446f6c-2af8-459d-a224-0945ac079c5f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:21.841899 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a0446f6c-2af8-459d-a224-0945ac079c5f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2" status: 204 len: 0 microversion: 2.64 time: 0.180979 Nov 02 12:49:21.848582 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 932/1853] 10.222.0.64 () {60 vars in 1307 bytes} [Wed Nov 2 12:49:21 2022] DELETE /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:49:21.857142 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dbce243-09a7-4384-8c1c-fc84018c4c2f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:49:21.865379 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5dbce243-09a7-4384-8c1c-fc84018c4c2f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] HTTP exception thrown: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dbce243-09a7-4384-8c1c-fc84018c4c2f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Request method failure captured: Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2 HTTP/1.1 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmdQJ0G_AE2I8E9p2G9VjhzeslWb75OMCtrGjcNIca6GG5k67SUeWOWLQCbmEt4aiJHV-XIdXUfQFf7YiwEPC4l_WuDrDoUkeMJU1Qheeh8oX-BAjPKCfvMoQvj_pRxjZL28CYzkIYvJJGIDve5p3S2HsJXc8POdpVemnTMlg_d6yFY Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Openstack-Nova-Api-Version: 2.64 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 55a4471c28cb45818f388321acb74608 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerGroup264TestJSON-192711408 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_55a4471c28cb45818f388321acb74608", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55a4471c28cb45818f388321acb74608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/55a4471c28cb45818f388321acb74608"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/55a4471c28cb45818f388321acb74608"}]}] Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerGroup264TestJSON-192711408 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 55a4471c28cb45818f388321acb74608 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerGroup264TestJSON-192711408 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerGroup264TestJSON-192711408-project Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 2797455f7ef140948189fab55f654585 Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerGroup264TestJSON-192711408-project Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '4f03ce66-42f5-487e-b431-8a9859455bf2'} Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1018, in wrapper Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:21.873726 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. Nov 02 12:49:21.879825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:21.882375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5dbce243-09a7-4384-8c1c-fc84018c4c2f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] Returning 404 to user: Instance group 4f03ce66-42f5-487e-b431-8a9859455bf2 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:21.885665 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5dbce243-09a7-4384-8c1c-fc84018c4c2f tempest-ServerGroup264TestJSON-192711408 tempest-ServerGroup264TestJSON-192711408-project] 10.222.0.64 "DELETE /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2" status: 404 len: 117 microversion: 2.64 time: 0.033010 Nov 02 12:49:21.889528 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 922/1854] 10.222.0.64 () {60 vars in 1307 bytes} [Wed Nov 2 12:49:21 2022] DELETE /compute/v2.1/os-server-groups/4f03ce66-42f5-487e-b431-8a9859455bf2 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:49:39.729812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:39.729812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=3 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:40.334255 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1884294573", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f8b092f0-7311-4609-993b-eb26c372f7e4"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:40.418908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] validate_networks() for [('f8b092f0-7311-4609-993b-eb26c372f7e4', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68de238d-d3a4-4233-8347-bebc01daf589) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:41.529511 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68de238d-d3a4-4233-8347-bebc01daf589) Nov 02 12:49:41.534512 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.537565 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:41.537565 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] Request method failure captured: Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 204 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmdjZivLZzaWgacWLRkBbwxvLSjsXAvhRdExCPYvpFW_y7mCcPhk4lS1G5tN-TCr12B42ZAIUOdZPjz7PJtouVeISLbNvM9lEJ2PsrnuaaO85J9o7n8J4AW59XhHpTSyWzWYxnIZCHKk5ivRHvy9jI8NTD0B6iKeX9ldk11PIwJrwQM Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.26 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: ce338ec547424ff38f2537cca88cf3a5 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerTagsTestJSON-1553972552 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce338ec547424ff38f2537cca88cf3a5", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce338ec547424ff38f2537cca88cf3a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce338ec547424ff38f2537cca88cf3a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce338ec547424ff38f2537cca88cf3a5"}]}] Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerTagsTestJSON-1553972552 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: ce338ec547424ff38f2537cca88cf3a5 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerTagsTestJSON-1553972552 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerTagsTestJSON-1553972552-project Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b5c0ed1768c543adaa49e1a8f65ed274 Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerTagsTestJSON-1553972552-project Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerTagsTestJSON-server-1884294573", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f8b092f0-7311-4609-993b-eb26c372f7e4"}]}} Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerTagsTestJSON-server-1884294573', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f8b092f0-7311-4609-993b-eb26c372f7e4'}]}}} Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:41.540534 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-68de238d-d3a4-4233-8347-bebc01daf589) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:49:41.553079 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.26 time: 1.815916 Nov 02 12:49:41.566268 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 933/1855] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:49:39 2022] POST /compute/v2.1/servers => generated 214 bytes in 1817 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:49:45.379779 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:49:45.704041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-621444777", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6928d18c-eb74-4b90-8689-c218672131c8"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:49:45.874966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] validate_networks() for [('6928d18c-eb74-4b90-8689-c218672131c8', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:46.543294 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b) Nov 02 12:49:46.547415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] Request method failure captured: Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 231 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmdo-5rFdHsh10dkZQganUbu2wv8l4AYPUTs0coT84mzs-CpdI25ZSuVvWKvHd0aawIBHxReRXQsHHQR6qsfeY2TjP_OogN474-4B5ZyUuu39neIRX76GW5S1-tDNBBXJeHzRP3pfwU3TfS336RahiZk7m36xpNFU5HEL88l65bRyxQ Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 892f4c0694c64e21974e5623ede6acfd Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-2116662386 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_892f4c0694c64e21974e5623ede6acfd", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/892f4c0694c64e21974e5623ede6acfd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/892f4c0694c64e21974e5623ede6acfd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/892f4c0694c64e21974e5623ede6acfd"}]}] Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-2116662386 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 892f4c0694c64e21974e5623ede6acfd Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-2116662386 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerMetadataNegativeTestJSON-2116662386-project Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 65b1444789194d61a3a4436630322d31 Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-2116662386-project Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-621444777", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "6928d18c-eb74-4b90-8689-c218672131c8"}]}} Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-621444777', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'metadata': {}, 'networks': [{'uuid': '6928d18c-eb74-4b90-8689-c218672131c8'}]}}} Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:49:46.562409 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ad0a8f81-f48f-4b7f-998f-9bf966115f6b) Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:46.567078 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-af1ea797-c040-4f94-825c-8dc72bac379c tempest-ServerMetadataNegativeTestJSON-2116662386 tempest-ServerMetadataNegativeTestJSON-2116662386-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.182653 Nov 02 12:49:46.571561 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 923/1856] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:49:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 1184 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:00.990413 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:00.992670 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3ecf2dfd-2e15-42fa-82b8-15a21bb9512b tempest-ServerTagsTestJSON-1553972552 tempest-ServerTagsTestJSON-1553972552-project] 10.222.0.64 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002786 Nov 02 12:50:00.993090 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 934/1857] 10.222.0.64 () {56 vars in 886 bytes} [Wed Nov 2 12:50:00 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:50:04.992867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:05.206759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-806791281", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:05.310075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-efe9e526-82f4-4f6e-9055-4d6b09983e23) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:05.965504 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-efe9e526-82f4-4f6e-9055-4d6b09983e23) Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 184 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-\u20a1-806791281", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-₡-806791281', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:05.969876 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:05.978851 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-efe9e526-82f4-4f6e-9055-4d6b09983e23) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dea7da48-49a5-42e9-ac35-a8bce3f0b4f4 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.982569 Nov 02 12:50:05.991706 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 924/1858] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 984 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:06.217445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1873187031", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:06.234102 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:06.884663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:07.544337 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b) Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 230 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersTestJSON-server-1873187031", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "testpassword", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1873187031', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'testpassword', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:07.550380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:07.554275 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c6e758a4-7977-4a55-b2e9-09d3acf9e36b) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-635cca89-35ea-41c0-9c29-af07954961d2 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.336858 Nov 02 12:50:07.566268 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 935/1859] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 1339 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:07.868001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e4e70631-f61b-43f3-81aa-8801382f7c52 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Action: 'create', calling method: .version_select at 0x7eff6080c4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1575905635"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:07.991242 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-929572318", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:08.131281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92229a80-094e-455e-92a4-239f06f93cbf) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:08.975507 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92229a80-094e-455e-92a4-239f06f93cbf) Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 230 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersTestJSON-server-929572318", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-929572318', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:08.981390 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:08.985733 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-92229a80-094e-455e-92a4-239f06f93cbf) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-47d17dad-0a89-41be-819d-48d295bbdd58 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.994978 Nov 02 12:50:08.994424 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 936/1860] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:07 2022] POST /compute/v2.1/servers => generated 214 bytes in 997 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:09.001568 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ca8e16bf-b641-472f-8047-aec438539b5e tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: .version_select at 0x7eff5c18e310>, body: {"keypair": {"name": "tempest-key-729712936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO7e7YkP1o7i3JK9JiLZde7nHQG/F0BBISCJG+pvwGrqiHkBRXLXD8VdjIoVwifQHJBQw7PrhGcdvReyCN26VoOwAZbNizSUZjnfbmB7sAIq5P4ab5Z6yNroAJu2LDXyJA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:09.044410 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ca8e16bf-b641-472f-8047-aec438539b5e tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Getting quotas for project d370c06216734957aebcbad237a18aec. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:50:09.052438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-ca8e16bf-b641-472f-8047-aec438539b5e tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Getting quotas for user 850992e758d24a5bbcffd81237623655 and project d370c06216734957aebcbad237a18aec. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:50:09.229584 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e4e70631-f61b-43f3-81aa-8801382f7c52 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.916844 Nov 02 12:50:09.232559 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ca8e16bf-b641-472f-8047-aec438539b5e tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.236387 Nov 02 12:50:09.234127 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 925/1861] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Nov 2 12:50:07 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1922 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:50:09.234469 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 937/1862] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:50:08 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:09.247735 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8b4921f8-4429-4fde-82fa-91ad676a367b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c18e820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:09.249715 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-41e5efbe-e8a2-4914-80fc-53a8c88f09cc tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Calling method '.version_select at 0x7eff5c2a00d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:09.277054 n-d-857339-6 devstack@n-api.service[127767]: WARNING oslo_db.sqlalchemy.utils [None req-41e5efbe-e8a2-4914-80fc-53a8c88f09cc tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unique keys not in sort_keys. The sorting order may be unstable. Nov 02 12:50:09.305431 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-41e5efbe-e8a2-4914-80fc-53a8c88f09cc tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.057028 Nov 02 12:50:09.327125 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 926/1863] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:50:09 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:09.344799 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8b4921f8-4429-4fde-82fa-91ad676a367b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.101160 Nov 02 12:50:09.345922 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 938/1864] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:09 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:09.504532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-35261659", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-key-729712936", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:09.586026 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2f46cce-0326-4445-be2b-aec46bc7ffe5) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:10.105051 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2f46cce-0326-4445-be2b-aec46bc7ffe5) Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 236 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestJSON-server-35261659", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-key-729712936", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-35261659', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-key-729712936', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:10.119220 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:10.124131 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b2f46cce-0326-4445-be2b-aec46bc7ffe5) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-706bc4cc-b88a-4659-8774-c78695026335 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.610436 Nov 02 12:50:10.130532 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 927/1865] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 612 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:10.138381 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1fc453c6-ae5f-4b17-8e54-79645713040d tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Calling method '.version_select at 0x7eff5c5c2160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:10.247236 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1fc453c6-ae5f-4b17-8e54-79645713040d tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-key-729712936" status: 202 len: 0 microversion: 2.1 time: 0.120420 Nov 02 12:50:10.248085 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 939/1866] 10.222.0.64 () {58 vars in 1206 bytes} [Wed Nov 2 12:50:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-729712936 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:50:10.342926 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-39565794", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:10.359830 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-68cc546e-8a61-45ba-a0c2-a75931f74eb1 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c7f24c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:10.458141 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-68cc546e-8a61-45ba-a0c2-a75931f74eb1 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.102768 Nov 02 12:50:10.458882 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 940/1867] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:10 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:11.117917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:11.485540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d2b4dcaf-98fd-4df5-b044-b73ee73c9941 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c2aa3a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:11.644317 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d2b4dcaf-98fd-4df5-b044-b73ee73c9941 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 346 microversion: 2.1 time: 0.175290 Nov 02 12:50:11.645531 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 941/1868] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:11 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 346 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:11.659578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cceb4744-677a-4416-9486-2f3bdfff56aa tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Action: 'create', calling method: .version_select at 0x7eff5c2aa4c0>, body: {"snapshot": {"volume_id": "f0bbe081-b087-44c3-9b75-ca150f623a13", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-34281144"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:11.855712 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760) Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:11.859968 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 199 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestJSON-server-39565794", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-39565794', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:11.873046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7be7a0e0-0c33-4b6b-ab03-818cf0eda760) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:11.877680 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.885792 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:11.902427 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:11.902427 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:11.908342 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e8666ee-7484-407d-9bf0-e4fadd682b04 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.567444 Nov 02 12:50:11.912202 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 928/1869] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1574 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:12.162037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1061937285", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:12.290132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:12.384912 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cceb4744-677a-4416-9486-2f3bdfff56aa tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.729893 Nov 02 12:50:12.392935 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 942/1870] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Nov 2 12:50:11 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:12.405012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d959e318-8848-47ab-8588-08bd71f96268 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c1c0f70>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:12.486081 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d959e318-8848-47ab-8588-08bd71f96268 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.086382 Nov 02 12:50:12.487543 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 943/1871] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:12 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:12.498540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9d364d8f-8b3b-4a7b-8c35-c6d2ffac646f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c38a790>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:12.586774 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9d364d8f-8b3b-4a7b-8c35-c6d2ffac646f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.081479 Nov 02 12:50:12.586774 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 944/1872] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Nov 2 12:50:12 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:12.595553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-64750880-e7e8-4ea8-9924-9ea61a01a61b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c5c2820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:12.640765 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-64750880-e7e8-4ea8-9924-9ea61a01a61b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.052676 Nov 02 12:50:12.642829 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 945/1873] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:12 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-afdfe28e-9468-46f4-99c5-726f7ef274b6) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:12.722823 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-afdfe28e-9468-46f4-99c5-726f7ef274b6) Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 201 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersTestJSON-server-1061937285", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1061937285', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:12.739054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:12.743443 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-afdfe28e-9468-46f4-99c5-726f7ef274b6) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9cecb555-85e7-4700-90f5-84714af3fcc6 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.570994 Nov 02 12:50:12.752276 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 929/1874] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 572 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 12:50:12.866618 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1049563555", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:12.978495 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] validate_networks() for [('b953d999-f7f5-4ecf-82ca-249a0d9c900e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:13.638034 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8) Nov 02 12:50:13.643165 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.644585 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:13.644585 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Request method failure captured: Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 201 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmd8Qa5nIOlTA0fXWs50dnkfSmK7nqBJPVbPGtom1iYeXb7OURMYyYsDSizo9JIeuxpDha5_-zBw3jskB4oUTQKM-2bvGhoeShJYQ-iVDAwnyYG6sToW4XayPwbUcNzQA3-XPc2_cRXmZ750WQHourl2q1mpQQku4L_gzXHUZxIlqJg Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d370c06216734957aebcbad237a18aec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d370c06216734957aebcbad237a18aec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d370c06216734957aebcbad237a18aec"}]}] Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersTestJSON-1021908919 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: d370c06216734957aebcbad237a18aec Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersTestJSON-1021908919 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 850992e758d24a5bbcffd81237623655 Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersTestJSON-1021908919-project Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServersTestJSON-server-1049563555", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "b953d999-f7f5-4ecf-82ca-249a0d9c900e"}]}} Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServersTestJSON-server-1049563555', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'b953d999-f7f5-4ecf-82ca-249a0d9c900e'}]}}} Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:13.645663 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cf3dd6b6-00d7-4b19-aa4e-7c5ac9ee73d8) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:13.655713 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5666c704-87b9-4e57-89ba-41af6485b007 tempest-ServersTestJSON-1021908919 tempest-ServersTestJSON-1021908919-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.795668 Nov 02 12:50:13.660648 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 946/1875] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:12 2022] POST /compute/v2.1/servers => generated 214 bytes in 797 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:13.671368 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cecaa19d-6a0b-477d-89de-5dd28908d3ae tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff6080c4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:13.712278 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cecaa19d-6a0b-477d-89de-5dd28908d3ae tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.060715 Nov 02 12:50:13.719950 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 930/1876] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:13 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:50:14.728611 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ec352ddd-80e6-4280-86bd-8e08bcbeb2ef tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c38a3a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:14.790751 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ec352ddd-80e6-4280-86bd-8e08bcbeb2ef tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.067721 Nov 02 12:50:14.791328 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 947/1877] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:14 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:15.808549 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f83419eb-6198-46be-b85d-e9497e44547f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff607ac8b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:15.852936 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f83419eb-6198-46be-b85d-e9497e44547f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 286 microversion: 2.1 time: 0.051302 Nov 02 12:50:15.859906 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 931/1878] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:15 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:15.866548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2dea1a69-cf91-4073-8c1c-66d44bc0d0a9 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5ce47940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:16.134361 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2dea1a69-cf91-4073-8c1c-66d44bc0d0a9 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 202 len: 0 microversion: 2.1 time: 0.266313 Nov 02 12:50:16.134361 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 948/1879] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 12:50:15 2022] DELETE /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:50:16.137328 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-52fd779a-ef5f-47f2-8e57-86ebce82510c tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c239d30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:16.192657 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-52fd779a-ef5f-47f2-8e57-86ebce82510c tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.059530 Nov 02 12:50:16.193243 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 932/1880] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:16 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:17.208263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fcc59e42-e318-4c45-b859-e4e91f94c9c9 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5ccb6670>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:17.308423 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fcc59e42-e318-4c45-b859-e4e91f94c9c9 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.106133 Nov 02 12:50:17.309567 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 949/1881] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:17 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:18.322660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-22c0817d-6780-40ff-ad45-5ece974ec697 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff607d93a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:18.404414 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-22c0817d-6780-40ff-ad45-5ece974ec697 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.086090 Nov 02 12:50:18.405675 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 933/1882] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:18 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:19.415271 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:19.419718 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6b4d0b64-58a4-4976-9f90-e7747508b8e2 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5cd1e940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:19.482726 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6b4d0b64-58a4-4976-9f90-e7747508b8e2 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 200 len: 285 microversion: 2.1 time: 0.067968 Nov 02 12:50:19.483913 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 950/1883] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:19 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 285 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:20.504201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b439fb9-ab52-40f8-bdb0-015bd2bc4bf3 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff607ac8b0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:20.563708 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-7b439fb9-ab52-40f8-bdb0-015bd2bc4bf3 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] HTTP exception thrown: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b439fb9-ab52-40f8-bdb0-015bd2bc4bf3 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Request method failure captured: Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 HTTP/1.1 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd_RB1Un_nmkTSkM166GniCElyEt8P95ftRXL465WVQ1SwaTu6978_Fbk8sTzbPa1bH63OrM044lPqX7b4yRZkdLatQuL_fJeKbo8Lv3Qjy0_EBfyL52UqidDJa6ljTrBGeHKPdu4m-leX7CQzeiQQWB51iCwkUAd8J2C5bZff87vY Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8a5e5bbe2bd149e2be51f8d6ba718c41", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}] Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 8d38203277d049a6acb7582883bab681 Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: exception: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '353f7158-1fd4-4b96-8abb-bffb12b81de9'} Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. (HTTP 404) (Request-ID: req-38b962b6-bc07-410b-b461-5b0c10591193) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:50:20.606287 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-7b439fb9-ab52-40f8-bdb0-015bd2bc4bf3 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Returning 404 to user: Snapshot 353f7158-1fd4-4b96-8abb-bffb12b81de9 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:20.614651 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-7b439fb9-ab52-40f8-bdb0-015bd2bc4bf3 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9" status: 404 len: 111 microversion: 2.1 time: 0.112154 Nov 02 12:50:20.620064 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 934/1884] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 12:50:20 2022] GET /compute/v2.1/os-snapshots/353f7158-1fd4-4b96-8abb-bffb12b81de9 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:50:20.620165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-93b0d45a-93b1-49bc-b945-189825f8bb71 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5ce479d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:20.894845 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-93b0d45a-93b1-49bc-b945-189825f8bb71 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 202 len: 0 microversion: 2.1 time: 0.281263 Nov 02 12:50:20.898682 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 951/1885] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:50:20 2022] DELETE /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:50:20.904270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a78e162a-7bb7-41fe-9c99-9c4898cb8f34 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff60776f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:20.968932 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a78e162a-7bb7-41fe-9c99-9c4898cb8f34 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.068494 Nov 02 12:50:20.977536 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 935/1886] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:20 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:21.984910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d6d6da32-7952-40df-9021-8103ba3bda5d tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c214820>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:22.100393 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d6d6da32-7952-40df-9021-8103ba3bda5d tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.120378 Nov 02 12:50:22.101106 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 952/1887] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:21 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:23.113753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=12 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:23.132665 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-03737a85-989a-4448-9980-38e124db6f07 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff608089d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:23.285654 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-03737a85-989a-4448-9980-38e124db6f07 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.174120 Nov 02 12:50:23.286941 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 936/1888] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:23 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:24.302904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d0872e9d-afb5-49f0-aebc-aef53e768b6f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c214d30>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:24.317561 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:24.427755 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d0872e9d-afb5-49f0-aebc-aef53e768b6f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 200 len: 345 microversion: 2.1 time: 0.129972 Nov 02 12:50:24.434766 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 953/1889] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:24 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:25.457214 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0a212fd7-ecae-49cf-ab6b-f41febd5434f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff607ac4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.558228 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-0a212fd7-ecae-49cf-ab6b-f41febd5434f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] HTTP exception thrown: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0a212fd7-ecae-49cf-ab6b-f41febd5434f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Request method failure captured: Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 HTTP/1.1 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd_RB1Un_nmkTSkM166GniCElyEt8P95ftRXL465WVQ1SwaTu6978_Fbk8sTzbPa1bH63OrM044lPqX7b4yRZkdLatQuL_fJeKbo8Lv3Qjy0_EBfyL52UqidDJa6ljTrBGeHKPdu4m-leX7CQzeiQQWB51iCwkUAd8J2C5bZff87vY Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8a5e5bbe2bd149e2be51f8d6ba718c41", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}] Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 8d38203277d049a6acb7582883bab681 Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: exception: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'f0bbe081-b087-44c3-9b75-ca150f623a13'} Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. (HTTP 404) (Request-ID: req-cf8bbc06-1df4-466f-b112-8ec9cc352284) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:50:25.564940 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.570577 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0a212fd7-ecae-49cf-ab6b-f41febd5434f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Returning 404 to user: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:25.575506 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0a212fd7-ecae-49cf-ab6b-f41febd5434f tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 404 len: 109 microversion: 2.1 time: 0.132020 Nov 02 12:50:25.575506 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 937/1890] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:25 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:50:25.586116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5c16ed65-64f4-4101-b8d3-a940d632b387 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff5c269280>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.683318 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-5c16ed65-64f4-4101-b8d3-a940d632b387 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] HTTP exception thrown: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5c16ed65-64f4-4101-b8d3-a940d632b387 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Request method failure captured: Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 HTTP/1.1 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmd_RB1Un_nmkTSkM166GniCElyEt8P95ftRXL465WVQ1SwaTu6978_Fbk8sTzbPa1bH63OrM044lPqX7b4yRZkdLatQuL_fJeKbo8Lv3Qjy0_EBfyL52UqidDJa6ljTrBGeHKPdu4m-leX7CQzeiQQWB51iCwkUAd8J2C5bZff87vY Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8a5e5bbe2bd149e2be51f8d6ba718c41", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}] Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8d38203277d049a6acb7582883bab681 Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: exception: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'f0bbe081-b087-44c3-9b75-ca150f623a13'} Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. (HTTP 404) (Request-ID: req-3517273e-3f48-4bce-94ec-0fe29f6f6dee) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:50:25.687043 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5c16ed65-64f4-4101-b8d3-a940d632b387 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Returning 404 to user: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5c16ed65-64f4-4101-b8d3-a940d632b387 tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 404 len: 109 microversion: 2.1 time: 0.108443 Nov 02 12:50:25.696877 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 954/1891] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:50:25 2022] DELETE /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:50:25.700443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5c797f4-c8f0-4617-9212-4fc914a70b5b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Calling method '.version_select at 0x7eff607acc10>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:25.759519 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-c5c797f4-c8f0-4617-9212-4fc914a70b5b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] HTTP exception thrown: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5c797f4-c8f0-4617-9212-4fc914a70b5b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Request method failure captured: Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 HTTP/1.1 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmd_RB1Un_nmkTSkM166GniCElyEt8P95ftRXL465WVQ1SwaTu6978_Fbk8sTzbPa1bH63OrM044lPqX7b4yRZkdLatQuL_fJeKbo8Lv3Qjy0_EBfyL52UqidDJa6ljTrBGeHKPdu4m-leX7CQzeiQQWB51iCwkUAd8J2C5bZff87vY Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8a5e5bbe2bd149e2be51f8d6ba718c41", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8a5e5bbe2bd149e2be51f8d6ba718c41"}]}] Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 8a5e5bbe2bd149e2be51f8d6ba718c41 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1054803546 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 8d38203277d049a6acb7582883bab681 Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1054803546-project Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: exception: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'f0bbe081-b087-44c3-9b75-ca150f623a13'} Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. (HTTP 404) (Request-ID: req-4782df4c-9c3d-4859-a1c7-6d38a179f307) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:50:25.761479 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5c797f4-c8f0-4617-9212-4fc914a70b5b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] Returning 404 to user: Volume f0bbe081-b087-44c3-9b75-ca150f623a13 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c5c797f4-c8f0-4617-9212-4fc914a70b5b tempest-VolumesSnapshotsTestJSON-1054803546 tempest-VolumesSnapshotsTestJSON-1054803546-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13" status: 404 len: 109 microversion: 2.1 time: 0.068227 Nov 02 12:50:25.767370 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 938/1892] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:50:25 2022] GET /compute/v2.1/os-volumes/f0bbe081-b087-44c3-9b75-ca150f623a13 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:50:28.514739 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1625444433", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:50:28.634152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] validate_networks() for [('3689f1b0-edd3-4063-89be-d5fa769863c9', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89346a27-0776-404a-8c88-e3626d7c4c7b) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:29.246771 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89346a27-0776-404a-8c88-e3626d7c4c7b) Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] Request method failure captured: Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 238 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmeTwL7Nc6JyB19X4k989JA9BHT06k8ehUH3oH6m_5LJk1BoIiYc7jjCr6XHFvQWj7ZBFlgXALNqRpDH6VUpXgZ6x_eALox0ZCeqfdnoVYbm3IQJp81Cigsql0VYWGdAbZ1iLgzyioSOYJivoyM_0ZGWBblNvuaQw4Jd7eFCkj_DgaY Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 658d7b13f50947999abfb7cc7da5cb25 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerRescueTestJSON-1571652383 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_658d7b13f50947999abfb7cc7da5cb25", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/658d7b13f50947999abfb7cc7da5cb25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/658d7b13f50947999abfb7cc7da5cb25"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/658d7b13f50947999abfb7cc7da5cb25"}]}] Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerRescueTestJSON-1571652383 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 658d7b13f50947999abfb7cc7da5cb25 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerRescueTestJSON-1571652383 Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerRescueTestJSON-1571652383-project Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b2ee0f7286134291b1f978cbe61fba1f Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerRescueTestJSON-1571652383-project Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerRescueTestJSON-server-1625444433", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "V8~q_Ik*8+D67kt", "networks": [{"uuid": "3689f1b0-edd3-4063-89be-d5fa769863c9"}]}} Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerRescueTestJSON-server-1625444433', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'V8~q_Ik*8+D67kt', 'networks': [{'uuid': '3689f1b0-edd3-4063-89be-d5fa769863c9'}]}}} Nov 02 12:50:29.261907 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:50:29.272822 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-89346a27-0776-404a-8c88-e3626d7c4c7b) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.166992 Nov 02 12:50:29.288743 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 955/1893] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:50:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 1168 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:50:46.565173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:46.566202 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-653995b3-136c-45e8-87cc-5943ca049c0e tempest-ServerRescueTestJSON-1571652383 tempest-ServerRescueTestJSON-1571652383-project] 10.222.0.64 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001947 Nov 02 12:50:46.567003 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 956/1894] 10.222.0.64 () {56 vars in 886 bytes} [Wed Nov 2 12:50:46 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:50:47.135140 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:47.137082 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.873266 Nov 02 12:50:47.137985 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 939/1895] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Nov 2 12:50:46 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:47.144480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:50:47.150644 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:47.166516 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.023548 Nov 02 12:50:47.167962 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 957/1896] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Nov 2 12:50:47 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:50:53.500774 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:53.502856 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002886 Nov 02 12:50:53.510467 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 940/1897] 10.222.0.64 () {56 vars in 886 bytes} [Wed Nov 2 12:50:53 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:50:53.512822 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:53.513701 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001716 Nov 02 12:50:53.514217 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 958/1898] 10.222.0.64 () {54 vars in 1035 bytes} [Wed Nov 2 12:50:53 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Nov 02 12:50:53.522797 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:53.529981 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5f635469-5278-4090-afac-6e98dbeb562e tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001628 Nov 02 12:50:53.529981 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 941/1899] 10.222.0.64 () {54 vars in 1041 bytes} [Wed Nov 2 12:50:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:50:53.538153 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:50:53.539344 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d28f44f6-ae68-4669-9575-426201447f95 tempest-ExtensionsTest-1486619812 tempest-ExtensionsTest-1486619812-project] 10.222.0.64 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001515 Nov 02 12:50:53.540118 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 959/1900] 10.222.0.64 () {56 vars in 886 bytes} [Wed Nov 2 12:50:53 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Nov 02 12:51:04.589543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e34c8a30-3898-4e79-9e24-272efe869d29 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Action: 'create', calling method: .version_select at 0x7eff607769d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-94319829", "metadata": {"Type": "work"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e34c8a30-3898-4e79-9e24-272efe869d29 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 120 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-94319829", "metadata": {"Type": "work"}}} Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-94319829', 'metadata': {'Type': 'work'}}}} Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:51:04.619046 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:51:04.628905 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.633253 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e34c8a30-3898-4e79-9e24-272efe869d29 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:04.635799 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e34c8a30-3898-4e79-9e24-272efe869d29 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.203183 Nov 02 12:51:04.637152 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 942/1901] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:51:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:51:04.645189 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:51:04.646053 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 12:51:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes (ip 10.222.0.64) !!! Nov 02 12:51:04.652876 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-593ead68-3c92-423a-9eec-8250639daef8 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Action: 'create', calling method: .version_select at 0x7eff5c2145e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1367178063", "metadata": {"Type": "work"}}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-593ead68-3c92-423a-9eec-8250639daef8 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 120 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1367178063", "metadata": {"Type": "work"}}} Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1367178063', 'metadata': {'Type': 'work'}}}} Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi '0' Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:51:04.674698 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:51:04.682905 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.686848 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-593ead68-3c92-423a-9eec-8250639daef8 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:04.693756 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-593ead68-3c92-423a-9eec-8250639daef8 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.045820 Nov 02 12:51:04.697615 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 960/1902] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:51:04 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:51:04.708979 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c1cf5369-d096-4e64-b0b6-8cf72367915c tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Action: 'create', calling method: .version_select at 0x7eff607305e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969641538", "metadata": {"Type": "work"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c1cf5369-d096-4e64-b0b6-8cf72367915c tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 118 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-969641538", "metadata": {"Type": "work"}}} Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-969641538', 'metadata': {'Type': 'work'}}}} Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi '' Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:51:04.716966 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:51:04.722842 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.728461 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c1cf5369-d096-4e64-b0b6-8cf72367915c tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:04.731060 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c1cf5369-d096-4e64-b0b6-8cf72367915c tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.027860 Nov 02 12:51:04.734680 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 943/1903] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:51:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:51:04.753884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8d407849-4a31-4acb-8927-4a3af5c3c20f tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Calling method '.version_select at 0x7eff5c5c20d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:04.827340 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-8d407849-4a31-4acb-8927-4a3af5c3c20f tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] HTTP exception thrown: Volume tempest-invalid-228982701 could not be found. Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8d407849-4a31-4acb-8927-4a3af5c3c20f tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-228982701 HTTP/1.1 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: exception: Volume tempest-invalid-228982701 could not be found. Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'tempest-invalid-228982701'} Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-228982701 could not be found. (HTTP 404) (Request-ID: req-96ff173e-7a98-4765-8e23-3f65cd27c886) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:51:04.832595 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-228982701 could not be found. Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-228982701 could not be found. Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-228982701 could not be found. Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:04.847389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8d407849-4a31-4acb-8927-4a3af5c3c20f tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 404 to user: Volume tempest-invalid-228982701 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:04.858050 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8d407849-4a31-4acb-8927-4a3af5c3c20f tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-228982701" status: 404 len: 98 microversion: 2.1 time: 0.117475 Nov 02 12:51:04.865206 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 961/1904] 10.222.0.64 () {58 vars in 1215 bytes} [Wed Nov 2 12:51:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-228982701 => generated 98 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:51:04.882003 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d3e961b6-503a-4b73-893e-16e555a25c7d tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015450 Nov 02 12:51:04.890527 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 944/1905] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Nov 2 12:51:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:51:04.901556 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e020d96a-b3dc-476b-a95a-6e0ec65b7eb9 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005099 Nov 02 12:51:04.902473 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 962/1906] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Nov 2 12:51:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:51:04.915798 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-875266df-ef5a-4074-acbd-e0c074e5871b tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Calling method '.version_select at 0x7eff60730550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:05.026953 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-875266df-ef5a-4074-acbd-e0c074e5871b tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] HTTP exception thrown: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-875266df-ef5a-4074-acbd-e0c074e5871b tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: request: DELETE /compute/v2.1/os-volumes/2c750d19-bdb5-4fdc-a797-83a516664430 HTTP/1.1 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: exception: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '2c750d19-bdb5-4fdc-a797-83a516664430'} Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. (HTTP 404) (Request-ID: req-3c15175f-0cde-441b-a6a7-652c2e2be9f4) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:51:05.030825 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.039415 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-875266df-ef5a-4074-acbd-e0c074e5871b tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 404 to user: Volume 2c750d19-bdb5-4fdc-a797-83a516664430 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:05.050573 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-875266df-ef5a-4074-acbd-e0c074e5871b tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/2c750d19-bdb5-4fdc-a797-83a516664430" status: 404 len: 109 microversion: 2.1 time: 0.129091 Nov 02 12:51:05.050573 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 945/1907] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:51:04 2022] DELETE /compute/v2.1/os-volumes/2c750d19-bdb5-4fdc-a797-83a516664430 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:05.058401 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a5c1dd11-bc48-4335-b18e-66a386165b53 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Calling method '.version_select at 0x7eff5ce47ca0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:05.107832 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-a5c1dd11-bc48-4335-b18e-66a386165b53 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] HTTP exception thrown: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a5c1dd11-bc48-4335-b18e-66a386165b53 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Request method failure captured: Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/os-volumes/42c40162-75d7-46af-885c-5ca22b01cc12 HTTP/1.1 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYme3jDH96fVwgfQ7c2KRpstDLIdkEwnzCpfHWzsGoqkhX0MDYGs3O4Vak9VTriGVbqQPXyJY02ssUrvoICun7RlJbCPR-lrjzd7FBIfEtOX1U0JMZbr4njs0g8ApFkPnpk1IiLoaui-AGbOAOlrc0DSe3Hfv6uT1hNfjwadMkhZNBoQ Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9bf31e1333ca44a4bc1431869095a4f2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9bf31e1333ca44a4bc1431869095a4f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9bf31e1333ca44a4bc1431869095a4f2"}]}] Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9bf31e1333ca44a4bc1431869095a4f2 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesNegativeTest-1762075720 Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: b1651d95be0548fda99fd1defc5efe5b Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesNegativeTest-1762075720-project Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: method: Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: exception: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '42c40162-75d7-46af-885c-5ca22b01cc12'} Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. (HTTP 404) (Request-ID: req-3d3c3878-194f-4877-93b3-5bb302473636) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:51:05.132530 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-a5c1dd11-bc48-4335-b18e-66a386165b53 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] Returning 404 to user: Volume 42c40162-75d7-46af-885c-5ca22b01cc12 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-a5c1dd11-bc48-4335-b18e-66a386165b53 tempest-VolumesNegativeTest-1762075720 tempest-VolumesNegativeTest-1762075720-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/42c40162-75d7-46af-885c-5ca22b01cc12" status: 404 len: 109 microversion: 2.1 time: 0.060677 Nov 02 12:51:05.144658 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 963/1908] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:51:05 2022] GET /compute/v2.1/os-volumes/42c40162-75d7-46af-885c-5ca22b01cc12 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:51:26.721164 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5128ed54-3bf3-42f3-9e58-9d060c51c52c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Action: 'create', calling method: .version_select at 0x7eff607769d0>, body: {"keypair": {"name": "tempest-keypair-2077433782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFGwXvnXbErr8haxpDywUSn1wta10XHy8YDgUZkLabymr/lYBW1V78hWraXuX0g65zvICIrKiCP3j+YZa/8+TBi5lpRLOnpFrDROaGc+VX/DsOtgM7184F/TtxCJJR3mA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:26.773253 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5128ed54-3bf3-42f3-9e58-9d060c51c52c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Getting quotas for project de7913a0ade441f797ed5d91fc6b6257. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:51:26.785381 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5128ed54-3bf3-42f3-9e58-9d060c51c52c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Getting quotas for user c94845bcdb1140f4b4841b1bf916d059 and project de7913a0ade441f797ed5d91fc6b6257. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:51:26.944178 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5128ed54-3bf3-42f3-9e58-9d060c51c52c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.773878 Nov 02 12:51:26.950712 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 946/1909] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:51:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 777 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:51:38.911281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1925513276", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "682c2865-4fa7-4779-ae52-2f235088dfa9"}], "security_groups": [{"name": "tempest-securitygroup--1315292409"}], "key_name": "tempest-keypair-2077433782", "user_data": "}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:39.925148 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] validate_networks() for [('682c2865-4fa7-4779-ae52-2f235088dfa9', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b914977-1882-456c-b74d-3c5bddb43bec) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:51:41.042978 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b914977-1882-456c-b74d-3c5bddb43bec) Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Request method failure captured: Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 492 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmfNXrYykXxEPN2lkTuwNwzCKeZT0_jn5U6F_GNz5fLNuVGQglEIQi9PHeCWsvLBghWQ4mEwPFls0k6B9FKzyRnOMLB0r7Ts17Mlmfr6rXEi3UZavh0_btczdON0XxkjCv4RYDH1AyWPxk4Qin7FJVfz7Vo0OP_ypeDQJ9XO0bh4K5Y Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: de7913a0ade441f797ed5d91fc6b6257 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_de7913a0ade441f797ed5d91fc6b6257", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de7913a0ade441f797ed5d91fc6b6257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/de7913a0ade441f797ed5d91fc6b6257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de7913a0ade441f797ed5d91fc6b6257"}]}] Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: de7913a0ade441f797ed5d91fc6b6257 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-AttachVolumeShelveTestJSON-1320329024-project Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: c94845bcdb1140f4b4841b1bf916d059 Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1320329024-project Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1925513276", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "682c2865-4fa7-4779-ae52-2f235088dfa9"}], "security_groups": [{"name": "tempest-securitygroup--1315292409"}], "key_name": "tempest-keypair-2077433782", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:51:41.052056 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-1925513276', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '682c2865-4fa7-4779-ae52-2f235088dfa9'}], 'security_groups': [{'name': 'tempest-securitygroup--1315292409'}], 'key_name': 'tempest-keypair-2077433782', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:51:41.055465 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9b914977-1882-456c-b74d-3c5bddb43bec) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-493c2b00-70b1-4e3d-b42b-19437f712498 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 2.156452 Nov 02 12:51:41.059206 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 964/1910] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:51:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 2159 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:51:41.065990 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1311efab-83d4-4372-beec-c49acf11abdf tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Calling method '.version_select at 0x7eff607d9310>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:41.071564 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:41.072877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:51:41.297716 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1311efab-83d4-4372-beec-c49acf11abdf tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077433782" status: 204 len: 0 microversion: 2.20 time: 0.239430 Nov 02 12:51:41.300201 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 947/1911] 10.222.0.64 () {60 vars in 1262 bytes} [Wed Nov 2 12:51:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077433782 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:51:43.237892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-83eee334-d20d-4212-9850-235f58ad05eb tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Action: 'create', calling method: .version_select at 0x7eff5c214670>, body: {"keypair": {"name": "tempest-keypair-4026615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJboPSSe9l5CC0Aaybl3PKM9EP0WQcWOxEz1XA4kh15bFpU/eFoi14NX0YLxLlPhivv/gZeIapfWNCKCvD8FEnLtOkvshFx3y/V7hO3KcALnHA1AjHNsm7UXP2donKkYg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:43.277637 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-83eee334-d20d-4212-9850-235f58ad05eb tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Getting quotas for project de7913a0ade441f797ed5d91fc6b6257. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:51:43.287165 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-83eee334-d20d-4212-9850-235f58ad05eb tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Getting quotas for user c94845bcdb1140f4b4841b1bf916d059 and project de7913a0ade441f797ed5d91fc6b6257. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:51:43.462353 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-83eee334-d20d-4212-9850-235f58ad05eb tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 398 microversion: 2.20 time: 0.230005 Nov 02 12:51:43.467997 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 965/1912] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Nov 2 12:51:43 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 233 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:51:51.222542 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1306644594", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "682c2865-4fa7-4779-ae52-2f235088dfa9"}], "security_groups": [{"name": "tempest-securitygroup--707184445"}], "key_name": "tempest-keypair-4026615", "user_data": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:51:51.774419 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] validate_networks() for [('682c2865-4fa7-4779-ae52-2f235088dfa9', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:51:52.249015 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61) Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:52.254069 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Request method failure captured: Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 488 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmfNXrYykXxEPN2lkTuwNwzCKeZT0_jn5U6F_GNz5fLNuVGQglEIQi9PHeCWsvLBghWQ4mEwPFls0k6B9FKzyRnOMLB0r7Ts17Mlmfr6rXEi3UZavh0_btczdON0XxkjCv4RYDH1AyWPxk4Qin7FJVfz7Vo0OP_ypeDQJ9XO0bh4K5Y Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: de7913a0ade441f797ed5d91fc6b6257 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_de7913a0ade441f797ed5d91fc6b6257", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de7913a0ade441f797ed5d91fc6b6257"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/de7913a0ade441f797ed5d91fc6b6257"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de7913a0ade441f797ed5d91fc6b6257"}]}] Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: de7913a0ade441f797ed5d91fc6b6257 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1320329024 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-AttachVolumeShelveTestJSON-1320329024-project Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: c94845bcdb1140f4b4841b1bf916d059 Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1320329024-project Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1306644594", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "password", "networks": [{"uuid": "682c2865-4fa7-4779-ae52-2f235088dfa9"}], "security_groups": [{"name": "tempest-securitygroup--707184445"}], "key_name": "tempest-keypair-4026615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-AttachVolumeShelveTestJSON-server-1306644594', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'password', 'networks': [{'uuid': '682c2865-4fa7-4779-ae52-2f235088dfa9'}], 'security_groups': [{'name': 'tempest-securitygroup--707184445'}], 'key_name': 'tempest-keypair-4026615', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:51:52.257041 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-f48e0a7f-76e4-4c74-bcb6-9b8325034b61) Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:52.262691 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0277100d-102b-49c0-83e1-15fdd0a6354c tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.20 time: 1.043609 Nov 02 12:51:52.283211 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 948/1913] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Nov 2 12:51:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 1045 msecs (HTTP/1.1 500) 9 headers in 393 bytes (1 switches on core 0) Nov 02 12:51:52.284548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-be46cb5d-f80c-4d08-8255-0667483c9843 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] Calling method '.version_select at 0x7eff5c5c2310>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:51:52.284548 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:51:52.284548 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 12:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-4026615 (ip 10.222.0.64) !!! Nov 02 12:51:52.468010 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-be46cb5d-f80c-4d08-8255-0667483c9843 tempest-AttachVolumeShelveTestJSON-1320329024 tempest-AttachVolumeShelveTestJSON-1320329024-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-4026615" status: 204 len: 0 microversion: 2.20 time: 0.201269 Nov 02 12:51:52.472102 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 966/1914] 10.222.0.64 () {60 vars in 1253 bytes} [Wed Nov 2 12:51:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-4026615 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:52:12.600736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:13.068829 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4fa4b890-1b43-4e1f-8dc3-2d2e86955a1d tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Action: 'create', calling method: .version_select at 0x7eff608439d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-156200936", "metadata": {"Type": "work"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:52:14.286461 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4fa4b890-1b43-4e1f-8dc3-2d2e86955a1d tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.692212 Nov 02 12:52:14.287637 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 949/1915] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Nov 2 12:52:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1694 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:52:14.297970 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:14.299138 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:52:14.303548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-48e9357e-f9b7-4e32-9835-ff2288e1e932 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c6f5040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:14.416758 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-48e9357e-f9b7-4e32-9835-ff2288e1e932 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.117384 Nov 02 12:52:14.420838 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 967/1916] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:14 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:15.429915 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de34ac48-5737-4b77-91cd-3ff579552e23 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff60730550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:15.590415 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de34ac48-5737-4b77-91cd-3ff579552e23 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.164848 Nov 02 12:52:15.598593 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 950/1917] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:15 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:16.609035 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-32cf9a6c-f3ff-4556-8310-06f0e96d9537 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c27a9d0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:16.670781 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-32cf9a6c-f3ff-4556-8310-06f0e96d9537 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.068772 Nov 02 12:52:16.672434 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 968/1918] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:16 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:17.693755 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0d7fdfc1-de66-4354-8831-f91f0e9847f4 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff607acd30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:17.775583 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0d7fdfc1-de66-4354-8831-f91f0e9847f4 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 353 microversion: 2.1 time: 0.093018 Nov 02 12:52:17.776682 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 951/1919] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:17 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:17.791360 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-67cf53cc-d455-4991-abc0-5783fd7c020c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c18edc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:17.880136 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-67cf53cc-d455-4991-abc0-5783fd7c020c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 353 microversion: 2.1 time: 0.094429 Nov 02 12:52:17.891499 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 969/1920] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:17 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:17.902660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a322f83a-f030-4b0f-8fcd-59be65475237 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c239d30>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:18.229880 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a322f83a-f030-4b0f-8fcd-59be65475237 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 202 len: 0 microversion: 2.1 time: 0.337358 Nov 02 12:52:18.239587 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 952/1921] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Nov 2 12:52:17 2022] DELETE /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:52:18.243548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-807bbcb1-cc8c-49d0-939f-965fd406a93c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c18e1f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:18.378351 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-807bbcb1-cc8c-49d0-939f-965fd406a93c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.140552 Nov 02 12:52:18.378955 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 970/1922] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:18 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:19.395778 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5944b4e4-717a-45b2-8715-7012821d02b5 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff607d93a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:19.649655 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5944b4e4-717a-45b2-8715-7012821d02b5 tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.259343 Nov 02 12:52:19.651621 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 953/1923] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:19 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:20.664910 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-db4db12b-c840-4ea9-85bc-0bf04d3a5a3c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c5c2160>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:20.796893 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-db4db12b-c840-4ea9-85bc-0bf04d3a5a3c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.135469 Nov 02 12:52:20.797986 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 971/1924] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:20 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:21.815969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1055098a-8730-477d-a8f1-aa9fcaeeaddd tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff60843dc0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:21.991855 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1055098a-8730-477d-a8f1-aa9fcaeeaddd tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.178216 Nov 02 12:52:21.995400 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 954/1925] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:21 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:23.010323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3fe85423-97e3-4216-abc4-cf145d9c1e2c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff5c6c43a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:23.146188 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3fe85423-97e3-4216-abc4-cf145d9c1e2c tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 200 len: 352 microversion: 2.1 time: 0.140421 Nov 02 12:52:23.147879 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 972/1926] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:23 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:52:24.163282 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b64fe8f2-baf4-4137-9bc8-3a611bfbdfda tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Calling method '.version_select at 0x7eff6080c3a0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:52:24.213402 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b64fe8f2-baf4-4137-9bc8-3a611bfbdfda tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] HTTP exception thrown: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b64fe8f2-baf4-4137-9bc8-3a611bfbdfda tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Request method failure captured: Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 HTTP/1.1 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmf8WLOmkcsSsYeuYcIAMnDsuzkWzMeirzhYk2zlaIeEJCBTMd9VvL3xoBnoHII_2YXmdBAgCXaA8EQP0JVsjDyMZlmtMUvIasT9ilJ8O_XAS2KAohCwfLK2EJQZK1VaW9m2P9cs2wcnM0aSiE3xMNaIy5Fvf0PTNdn917n71EdV2HY Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9b68dd5ddfaf4981a5262d3ff99d4595 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesGetTestJSON-384035143 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9b68dd5ddfaf4981a5262d3ff99d4595", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9b68dd5ddfaf4981a5262d3ff99d4595"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9b68dd5ddfaf4981a5262d3ff99d4595"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9b68dd5ddfaf4981a5262d3ff99d4595"}]}] Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesGetTestJSON-384035143 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9b68dd5ddfaf4981a5262d3ff99d4595 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesGetTestJSON-384035143 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesGetTestJSON-384035143-project Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 4b64891cd6d44679b8a22b4303a97700 Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesGetTestJSON-384035143-project Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: method: Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: exception: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '4f123926-6882-43d1-af3d-9b5e1de9e988'} Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. (HTTP 404) (Request-ID: req-d23756ed-d258-4fbc-8560-a4cb28863a48) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:52:24.222961 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b64fe8f2-baf4-4137-9bc8-3a611bfbdfda tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] Returning 404 to user: Volume 4f123926-6882-43d1-af3d-9b5e1de9e988 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b64fe8f2-baf4-4137-9bc8-3a611bfbdfda tempest-VolumesGetTestJSON-384035143 tempest-VolumesGetTestJSON-384035143-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988" status: 404 len: 109 microversion: 2.1 time: 0.060117 Nov 02 12:52:24.227560 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 955/1927] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Nov 2 12:52:24 2022] GET /compute/v2.1/os-volumes/4f123926-6882-43d1-af3d-9b5e1de9e988 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 12:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 12:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 12:58:42.478387 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 12:58:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 12:58:43.164083 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-91387ef3-6452-442a-a410-296c4f051365 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Action: 'create', calling method: .version_select at 0x7eff5c726670>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-299707256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2Uo6O/BCkjQI4CmAjlTzf45Z+BnVRZ4r8xQQ+hWDvMEOJSiaF/ZzcOeybZ+vndR9js+D0aD8g6m/S49CVHWFkNaAG+Yhzvx4r6VjCB+5lYxv8adoO3FIRkwZKwxp+OFA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:43.235488 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-91387ef3-6452-442a-a410-296c4f051365 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Getting quotas for project 2c29a45b18b948beb86b5f13b25e46b9. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:58:43.247081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-91387ef3-6452-442a-a410-296c4f051365 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Getting quotas for user 2f0a27458da7483e81250180de9beb45 and project 2c29a45b18b948beb86b5f13b25e46b9. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:58:43.422448 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-91387ef3-6452-442a-a410-296c4f051365 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.957762 Nov 02 12:58:43.423773 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 973/1928] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 12:58:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:58:43.911694 n-d-857339-6 devstack@n-api.service[127767]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b4c828aa-74cf-4cac-b1f4-ebfb58212397] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:58:43.916950 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:58:43.916950 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 12:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 12:58:43.916950 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:58:43.916950 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 12:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 12:58:43.921790 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:58:43.921790 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 12:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 12:58:44.164394 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-678815472", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e4a3fbc0-2fb5-4c60-9978-3ea068163e4f"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:58:44.863828 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] validate_networks() for [('e4a3fbc0-2fb5-4c60-9978-3ea068163e4f', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:58:44.922310 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] [b4c828aa-74cf-4cac-b1f4-ebfb58212397] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 60310. Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:58:47.699331 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2) Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:58:47.709268 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] Request method failure captured: Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 205 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYml7TTFqKJGhobmxsAHDBZib6BtVn5FLGttN5bqlcwEfwLelzUEKATg4AD7Qqlv4JT_fyyYHSCdQOOiXwywwPfWn6KmTDGDIdE16ih2cgKL-W7ZQNqd-LSFvKbVcX8MIeYb89232g6oNuJVZCKFHWpGSJL0C_97hEsFbBFGx-JbNWxs Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0496e97d046243a298cd6e60e13c289e Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesActionsTest-1918536789 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0496e97d046243a298cd6e60e13c289e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0496e97d046243a298cd6e60e13c289e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0496e97d046243a298cd6e60e13c289e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0496e97d046243a298cd6e60e13c289e"}]}] Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesActionsTest-1918536789 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0496e97d046243a298cd6e60e13c289e Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesActionsTest-1918536789 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesActionsTest-1918536789-project Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 167004f9694344f1b595951ff2338753 Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesActionsTest-1918536789-project Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-VolumesActionsTest-instance-678815472", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e4a3fbc0-2fb5-4c60-9978-3ea068163e4f"}]}} Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-678815472', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'e4a3fbc0-2fb5-4c60-9978-3ea068163e4f'}]}}} Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:58:47.717391 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-61ab88f4-304e-4642-b32c-e1eaa3d61ea2) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:58:47.727613 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5e835556-f22a-4809-9e2e-ca70d4d1f66c tempest-VolumesActionsTest-1918536789 tempest-VolumesActionsTest-1918536789-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 3.813091 Nov 02 12:58:47.739791 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 956/1929] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:58:43 2022] POST /compute/v2.1/servers => generated 214 bytes in 3817 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:59:14.970951 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-826378354-access_point-1072254900", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ae53e63b-00d4-4360-8065-a5a981d950b3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-299707256", "security_groups": [{"name": "tempest-secgroup_access--432595127"}, {"name": "tempest-secgroup_general--1099761609"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:59:15.044154 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:15.045304 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:15.705251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] validate_networks() for [('ae53e63b-00d4-4360-8065-a5a981d950b3', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ed3ef2f9-c404-499e-b173-4be5be17db4d) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:59:16.803311 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ed3ef2f9-c404-499e-b173-4be5be17db4d) Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:59:16.822265 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Request method failure captured: Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 468 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYml-8AaTM3S07fconXv4e9F8Zv8n8bmVK6wtX4kNr9Jh9gAKzqzs0fRkrNTmtNfdC5jDxhcQ-vAM6dx0DDrn264CbeBI-S05xIYohH03y361KDAck6YtwmItUuMvIcxHRSvVlLUqgG3qiidtDlJOtJJO3x64NI_A_pBLJk1oJq17Bt0 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 2c29a45b18b948beb86b5f13b25e46b9 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-826378354 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2c29a45b18b948beb86b5f13b25e46b9", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2c29a45b18b948beb86b5f13b25e46b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2c29a45b18b948beb86b5f13b25e46b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2c29a45b18b948beb86b5f13b25e46b9"}]}] Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestSecurityGroupsBasicOps-826378354 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 2c29a45b18b948beb86b5f13b25e46b9 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-826378354 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestSecurityGroupsBasicOps-826378354-project Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 2f0a27458da7483e81250180de9beb45 Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestSecurityGroupsBasicOps-826378354-project Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-826378354-access_point-1072254900", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ae53e63b-00d4-4360-8065-a5a981d950b3"}], "key_name": "tempest-TestSecurityGroupsBasicOps-299707256", "security_groups": [{"name": "tempest-secgroup_access--432595127"}, {"name": "tempest-secgroup_general--1099761609"}]}, "os:scheduler_hints": {"different_host": []}} Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-server-tempest-TestSecurityGroupsBasicOps-826378354-access_point-1072254900', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'ae53e63b-00d4-4360-8065-a5a981d950b3'}], 'key_name': 'tempest-TestSecurityGroupsBasicOps-299707256', 'security_groups': [{'name': 'tempest-secgroup_access--432595127'}, {'name': 'tempest-secgroup_general--1099761609'}]}, 'os:scheduler_hints': {'different_host': []}}} Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 12:59:16.824427 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ed3ef2f9-c404-499e-b173-4be5be17db4d) Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:16.842827 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-69d50fcc-8bb1-4a03-a0d4-55f88ae2d97f tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.867228 Nov 02 12:59:16.885342 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 974/1930] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 12:59:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 1883 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 12:59:35.338252 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3903094c-7902-42da-9146-3652c3c67188 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] Calling method '.version_select at 0x7eff5c2a0e50>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:59:35.356682 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:59:35.453487 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3903094c-7902-42da-9146-3652c3c67188 tempest-TestSecurityGroupsBasicOps-826378354 tempest-TestSecurityGroupsBasicOps-826378354-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-299707256" status: 202 len: 0 microversion: 2.1 time: 0.121812 Nov 02 12:59:35.454090 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 957/1931] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Nov 2 12:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-299707256 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:00:00.208685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:00.843119 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1627850431", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6c1add9f-551f-4978-b896-152b851a96c7"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:00.917764 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] validate_networks() for [('6c1add9f-551f-4978-b896-152b851a96c7', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:00:02.004205 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47) Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] Request method failure captured: Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 207 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmnItp1iklZRQKsZN1Zrsv3682lu4TZxNJ8GQ9-ftMgRfrf_5PiNBjjgzNNC6hCj2FHQTUp7Q7186HXCPAFFjcoLD4xjIe689_vtL1rr3qxnaccLj1aTHWAf44Zpp85QHA79akiWuxR-6gJBOt8AjxRgjCxaTzMF2yFL8J8pueogejQ Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 7acfadad50ce4521ae4e3d2ad73c0b1e Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestServerAdvancedOps-598180786 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7acfadad50ce4521ae4e3d2ad73c0b1e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7acfadad50ce4521ae4e3d2ad73c0b1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7acfadad50ce4521ae4e3d2ad73c0b1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7acfadad50ce4521ae4e3d2ad73c0b1e"}]}] Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestServerAdvancedOps-598180786 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 7acfadad50ce4521ae4e3d2ad73c0b1e Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestServerAdvancedOps-598180786 Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestServerAdvancedOps-598180786-project Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: cc68e1cc8efe419eb71c94d43c6bd88e Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestServerAdvancedOps-598180786-project Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestServerAdvancedOps-server-1627850431", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "6c1add9f-551f-4978-b896-152b851a96c7"}]}} Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestServerAdvancedOps-server-1627850431', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '6c1add9f-551f-4978-b896-152b851a96c7'}]}}} Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:02.008915 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:00:02.015460 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-eb1ef785-9199-4bd7-a0fc-4baaf5a41f47) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6bcf645c-3920-4679-93d8-748b19aee307 tempest-TestServerAdvancedOps-598180786 tempest-TestServerAdvancedOps-598180786-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.801063 Nov 02 13:00:02.019647 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 975/1932] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:00:00 2022] POST /compute/v2.1/servers => generated 214 bytes in 1805 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:00:05.824064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1876245576", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:05.927699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:00:06.694272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:00:06.705785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:00:06.707020 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:00:06.708177 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:00:06.709555 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:00:06.722387 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.726725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.726725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.726725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:06.726725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:06.726725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:06.784022 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Getting quotas for project 8b2a8740e62546739e8aa1ba5ce38aed. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:00:06.830588 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Getting quotas for user c5941a1c8f324201ba8ac980d55ea942 and project 8b2a8740e62546739e8aa1ba5ce38aed. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:00:06.906076 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:00:06.909077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:00:07.251442 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5fdcbcfd-78f2-4635-ba36-fe1aa15f3ada tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.433728 Nov 02 13:00:07.252306 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 958/1933] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:00:07.267809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-8e3c0d4a-2342-4bae-9b4f-8e24d89e7435 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:07.267809 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-8e3c0d4a-2342-4bae-9b4f-8e24d89e7435 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:07.382736 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-8e3c0d4a-2342-4bae-9b4f-8e24d89e7435 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:07.409344 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-8e3c0d4a-2342-4bae-9b4f-8e24d89e7435 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1215 microversion: 2.1 time: 0.147609 Nov 02 13:00:07.412709 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 976/1934] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:07 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1215 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:08.443955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d881d4e9-13bb-4312-b66e-5062b70a88ce tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:08.443955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-d881d4e9-13bb-4312-b66e-5062b70a88ce tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:08.560338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-d881d4e9-13bb-4312-b66e-5062b70a88ce tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:08.572693 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d881d4e9-13bb-4312-b66e-5062b70a88ce tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1215 microversion: 2.1 time: 0.141732 Nov 02 13:00:08.577297 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 959/1935] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:08 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1215 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:09.613889 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-40742765-cf21-45bb-8a70-265599fe3b9c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:09.615647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-40742765-cf21-45bb-8a70-265599fe3b9c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:09.932320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-40742765-cf21-45bb-8a70-265599fe3b9c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:09.948918 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-40742765-cf21-45bb-8a70-265599fe3b9c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1215 microversion: 2.1 time: 0.346272 Nov 02 13:00:09.949812 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 977/1936] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:09 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1215 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:11.512285 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:11.545978 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:11.571151 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a5a6ab78-55ea-491a-8035-557a7c6e0809 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1219 microversion: 2.1 time: 0.598620 Nov 02 13:00:11.572337 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 960/1937] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:10 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1219 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:12.619907 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:12.621480 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:12.637214 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:12.638178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:12.638879 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:12.640161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:12.642912 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:12.643549 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:12.926797 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:12.952352 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-737b5268-ca37-4c4a-9d98-641afa85e1ff tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1267 microversion: 2.1 time: 0.334492 Nov 02 13:00:12.953215 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 978/1938] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:12 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1267 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:13.985839 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:13.987100 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:13.994847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.995552 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.996149 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:13.997025 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:13.997871 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:13.998435 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:14.205877 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:14.224181 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b78d35e1-4bc7-4c0a-a186-8c0b8a9e2880 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1285 microversion: 2.1 time: 0.242228 Nov 02 13:00:14.227320 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 961/1939] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:13 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1285 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:15.276973 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:15.277620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:15.298386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.298899 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.299346 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.311419 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:15.312060 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:15.312531 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:15.559503 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:15.569980 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-4fbd2d8f-7d9d-4111-994e-2a9ced79c60f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1273 microversion: 2.1 time: 0.297387 Nov 02 13:00:15.570594 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 979/1940] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:15 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:16.596454 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:16.598161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:16.614461 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:16.616587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:16.617400 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:16.619800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:16.623880 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:16.626064 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:16.747660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:17.425778 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:17.444181 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9b6d6455-5d53-49c4-85a4-de2afe648f6c tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.844996 Nov 02 13:00:17.444181 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 962/1941] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:16 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:18.465634 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:18.466995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:18.478084 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:18.483128 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:18.484080 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:18.485639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:18.486343 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:18.487012 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:18.855249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:18.869090 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-603aa0cd-9bfc-4498-beb4-d4962f0f7e52 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.407430 Nov 02 13:00:18.880836 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 980/1942] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:18 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:19.829756 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:19.908059 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:19.908727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:19.918627 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:19.919143 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:19.919667 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:19.920313 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:19.940863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:19.941781 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:19.943181 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:20.439590 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea541eb-564d-4d5b-ad53-f49af9992092", "tag": "2d09d596-f6fc-49ce-b943-5222047e459e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:20.480863 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:20.481692 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:20.482150 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:20.520709 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] Creating event network-changed:2d09d596-f6fc-49ce-b943-5222047e459e for instance 0ea541eb-564d-4d5b-ad53-f49af9992092 on n-h1-857339-6 Nov 02 13:00:20.541600 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-e6455bc0-79d8-4256-b3af-88c5eb4ef813 req-320bdf05-5214-4c11-86c3-7a1fa26c1cbe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.714437 Nov 02 13:00:20.542897 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 963/1943] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:21.996738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:22.011869 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5163d312-774b-4c2e-8f34-f0f645bc867e tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 2.108676 Nov 02 13:00:22.031686 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 981/1944] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:19 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:23.044439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:23.045254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:23.086014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:23.089085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:23.089619 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:23.090461 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:23.091920 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:23.092396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:23.749375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:23.759494 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f5a5804b-44ca-4ee6-acd6-02ede864def5 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.724583 Nov 02 13:00:23.773326 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 964/1945] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:23 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:24.798952 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:24.799577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:24.829683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:24.829683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:24.829683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:24.829683 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:24.829913 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:24.830337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:25.670100 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:25.677248 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6a757b19-6f6e-47c4-90d6-c0e8e85f9147 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.890411 Nov 02 13:00:25.696138 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 982/1946] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:24 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:26.716170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:26.717562 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:26.741878 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:26.746319 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:26.749479 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:26.750544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:26.751181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:26.751773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:27.121315 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:27.153421 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b1070ed7-55ca-467a-aadc-74e293b40b62 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.449584 Nov 02 13:00:27.180816 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 965/1947] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:26 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:28.186444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:28.186444 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:28.203747 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:28.213415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:28.213415 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:28.224749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:28.224749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:28.224749 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:29.016892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:29.048401 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e90a6ccf-b21b-4113-9ad6-616c5a924735 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.870556 Nov 02 13:00:29.049537 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 983/1948] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:28 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:30.075644 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:30.085960 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:30.134332 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:30.138169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:30.139151 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:30.165759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:30.168235 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:30.170725 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:30.583946 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:30.598482 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6eb141e0-ffe3-4b66-863b-fbd3da8b5485 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.530544 Nov 02 13:00:30.599122 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 966/1949] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:30 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:31.628553 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:31.629523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:31.651580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=23 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:31.666647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:31.672309 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:31.673527 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:31.674793 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:31.675653 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:31.676464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:31.997122 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea541eb-564d-4d5b-ad53-f49af9992092", "name": "network-vif-plugged", "status": "completed", "tag": "2d09d596-f6fc-49ce-b943-5222047e459e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:32.023751 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:32.028324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:32.028816 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:32.074620 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] Creating event network-vif-plugged:2d09d596-f6fc-49ce-b943-5222047e459e for instance 0ea541eb-564d-4d5b-ad53-f49af9992092 on n-h1-857339-6 Nov 02 13:00:32.081913 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-da412665-3330-44ad-985d-8c163f8207d1 req-8664fa92-72b8-4c02-b358-2ff78e582270 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274022 Nov 02 13:00:32.083435 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 967/1950] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:32.319429 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:32.354295 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ef75d7ad-55d1-4c20-873c-52cce6322f3f tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.731510 Nov 02 13:00:32.358901 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 984/1951] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:31 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:33.384952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:33.386477 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:33.398870 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:33.399765 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:33.400401 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:33.401303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:33.402594 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:33.404236 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:34.225139 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:34.244858 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5461a5c5-ac26-4682-a9f3-8c0c8edeeed8 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1315 microversion: 2.1 time: 0.866573 Nov 02 13:00:34.249036 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 968/1952] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:33 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:35.281512 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.283824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:35.319421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.325431 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.327350 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.328418 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.334226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.337577 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.815528 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:35.830114 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fa7d27c1-d27b-4468-af69-5cbd494d4086 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1464 microversion: 2.1 time: 0.560337 Nov 02 13:00:35.833214 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 985/1953] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:35 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1464 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:35.925079 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:35.925584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:35.944077 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:35.950403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.950403 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.955304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:35.958267 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:35.958851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:35.959303 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:36.026703 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=49 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:36.061216 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:00:36.794613 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-86effb9d-d6e5-4625-b1e2-7088b3b1b018 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 204 len: 0 microversion: 2.1 time: 0.874218 Nov 02 13:00:36.795316 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 969/1954] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 13:00:35 2022] DELETE /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:00:36.804620 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:36.806109 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:36.817724 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:36.819838 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:36.823320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:36.824341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:36.826639 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:36.831045 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:37.220308 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:37.232577 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9dc396c5-5aea-4b02-8e4d-3916cb33b912 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1470 microversion: 2.1 time: 0.432384 Nov 02 13:00:37.238425 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 986/1955] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:36 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1470 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:38.267541 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:38.268262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:38.287344 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.287842 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.288281 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:38.289604 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:38.290074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:38.290503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:39.980851 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:39.989479 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-96466c6e-1aea-462f-b2ca-ddf18e33e5cb tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1470 microversion: 2.1 time: 1.726969 Nov 02 13:00:39.990093 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 970/1956] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:38 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1470 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:00:41.012999 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:41.013673 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:41.025175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:41.025675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:41.028462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:41.030541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:41.031022 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:41.032019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:41.215924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:41.229579 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-68990da4-49ed-483b-96a2-6fa9c21aad99 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1428 microversion: 2.1 time: 0.221007 Nov 02 13:00:41.230195 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 987/1957] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:41 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1428 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:41.314107 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea541eb-564d-4d5b-ad53-f49af9992092", "name": "network-vif-deleted", "tag": "2d09d596-f6fc-49ce-b943-5222047e459e"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:00:41.356463 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:41.357329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:41.358007 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:41.373206 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] Creating event network-vif-deleted:2d09d596-f6fc-49ce-b943-5222047e459e for instance 0ea541eb-564d-4d5b-ad53-f49af9992092 on n-h1-857339-6 Nov 02 13:00:41.381435 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-7e1acce4-5467-4644-ac5d-dda0e26218c0 req-cc10d567-2367-4795-8ae9-c8f78f05d26b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073086 Nov 02 13:00:41.387777 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 971/1958] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:00:42.255443 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:42.256074 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:42.271251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:42.271863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:42.272376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:42.275884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:42.276462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:42.277044 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:42.388871 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:42.389457 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:42.391156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:42.392056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lazy-loading 'fault' on Instance uuid 0ea541eb-564d-4d5b-ad53-f49af9992092 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:00:42.507219 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:42.528330 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-981abf92-1f0a-4e12-b402-b14ace18e578 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1305 microversion: 2.1 time: 0.272668 Nov 02 13:00:42.533083 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 988/1959] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:42 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1305 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:43.565248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:43.565248 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:43.570019 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:43.571246 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:43.571912 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:43.573419 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:43.574131 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:43.574832 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:43.656298 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:43.657671 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:43.658523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:43.659686 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lazy-loading 'fault' on Instance uuid 0ea541eb-564d-4d5b-ad53-f49af9992092 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:00:44.537876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5941a1c8f324201ba8ac980d55ea942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b2a8740e62546739e8aa1ba5ce38aed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:00:44.546084 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0314e0bb-eba9-4ccb-b305-8a46407b09b3 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 200 len: 1305 microversion: 2.1 time: 0.992038 Nov 02 13:00:44.560693 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 972/1960] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:43 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 1305 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] [instance: 0ea541eb-564d-4d5b-ad53-f49af9992092] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=69 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] HTTP exception thrown: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Request method failure captured: Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 HTTP/1.1 Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmnQxvpaXiZbvPovqNXXMTCayTuSC5rXoX6YjxblvipzPF5OM5Gl3-rdFtxSMAKqK-CaLCfSWiy4uAZXNBcu48ADMNMPe4xc0y7xfcELSWaAFOozpBdD5A8M4tPXZdjB7h7l0vtTSPPxvg-ehVk-g_sZ6ZyEQ8FzcjcRVB-TZMs054g Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 8b2a8740e62546739e8aa1ba5ce38aed Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesNegativeTest-2015848530 Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:00:45.694941 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_8b2a8740e62546739e8aa1ba5ce38aed", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b2a8740e62546739e8aa1ba5ce38aed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/8b2a8740e62546739e8aa1ba5ce38aed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/8b2a8740e62546739e8aa1ba5ce38aed"}]}] Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesNegativeTest-2015848530 Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 8b2a8740e62546739e8aa1ba5ce38aed Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesNegativeTest-2015848530 Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesNegativeTest-2015848530-project Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: c5941a1c8f324201ba8ac980d55ea942 Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesNegativeTest-2015848530-project Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': '0ea541eb-564d-4d5b-ad53-f49af9992092'} Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:00:45.713129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] Returning 404 to user: Instance 0ea541eb-564d-4d5b-ad53-f49af9992092 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:00:45.731025 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-755ab2e8-1e05-4108-832d-3619ddeee559 tempest-VolumesNegativeTest-2015848530 tempest-VolumesNegativeTest-2015848530-project] 10.222.0.64 "GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092" status: 404 len: 111 microversion: 2.1 time: 0.069422 Nov 02 13:00:45.731025 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 989/1961] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:00:45 2022] GET /compute/v2.1/servers/0ea541eb-564d-4d5b-ad53-f49af9992092 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:01:10.870628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:10.871502 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:10.882244 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2025325647", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:11.047819 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] validate_networks() for [('ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:11.804714 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586) Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:11.814709 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Request method failure captured: Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 211 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmlqNprMk2kpsOUv-uYGql0w48Ih8jDgh-48I-xnEO5T6pvbO_QcOKMLs7g69jTdfZDK4yac8f_epflAobRg9wtTp-IsWiFwLgFBi6ESHguYc6sOOMBZVlE6dmZYhXWCNDFBjpI-WsFifQhR5QIsErtSaiBqdcsFTz1uujdVuvEEoCE Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2688c21d1c2446738e30f08d35853087 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2688c21d1c2446738e30f08d35853087", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2688c21d1c2446738e30f08d35853087"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2688c21d1c2446738e30f08d35853087"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2688c21d1c2446738e30f08d35853087"}]}] Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2688c21d1c2446738e30f08d35853087 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesSnapshotTestJSON-2080269117-project Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 0373f7b34b984b07b8ab3f3965a7ea6d Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesSnapshotTestJSON-2080269117-project Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2025325647", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e"}]}} Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-2025325647', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e'}]}}} Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:11.842807 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-bdeaa04f-08c1-4b6e-a8ef-cfce89b92586) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:01:11.850963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.860819 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:11.873103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:11.873103 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:11.877702 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-60dff99f-f11f-4e65-9e94-1a813d5945cb tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.006024 Nov 02 13:01:11.877702 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 973/1962] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 1009 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:01:30.036016 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1438110720", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:30.067494 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=13 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:30.146575 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] validate_networks() for None {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:30.223254 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1514671186", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:30.513088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] validate_networks() for [('ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:31.877698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Flavor limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:01:31.878156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Image limits 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:01:31.878600 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Flavor pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:01:31.879541 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Image pref 0:0:0 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:01:31.880019 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.virt.hardware [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:01:31.899316 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.899892 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.900258 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.901025 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:31.924106 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:31.924843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:31.981964 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Getting quotas for project 34bf3744309d4381acf25152b0225203. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:31.997113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Getting quotas for user cfc554a51c084c45805c44333f345b8d and project 34bf3744309d4381acf25152b0225203. Resources: {'ram', 'cores', 'instances'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:32.033731 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Going to run 1 instances... {{(pid=127766) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:01:32.055741 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:32.143699 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2) Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:32.148233 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Request method failure captured: Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 211 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmlqNprMk2kpsOUv-uYGql0w48Ih8jDgh-48I-xnEO5T6pvbO_QcOKMLs7g69jTdfZDK4yac8f_epflAobRg9wtTp-IsWiFwLgFBi6ESHguYc6sOOMBZVlE6dmZYhXWCNDFBjpI-WsFifQhR5QIsErtSaiBqdcsFTz1uujdVuvEEoCE Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 2688c21d1c2446738e30f08d35853087 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2688c21d1c2446738e30f08d35853087", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2688c21d1c2446738e30f08d35853087"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2688c21d1c2446738e30f08d35853087"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2688c21d1c2446738e30f08d35853087"}]}] Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 2688c21d1c2446738e30f08d35853087 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2080269117 Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesSnapshotTestJSON-2080269117-project Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 0373f7b34b984b07b8ab3f3965a7ea6d Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesSnapshotTestJSON-2080269117-project Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1514671186", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e"}]}} Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-VolumesSnapshotTestJSON-instance-1514671186', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'ce72d6b8-fcfe-4e41-8a6a-5fc6bccfe04e'}]}}} Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:32.151025 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7b73b905-5ce4-4a05-a8cf-0b828bf37be2) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:01:32.154794 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.158189 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:32.159569 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:32.159569 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:32.164641 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e6c4f965-3609-48e4-aa10-2207fa518578 tempest-VolumesSnapshotTestJSON-2080269117 tempest-VolumesSnapshotTestJSON-2080269117-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.965893 Nov 02 13:01:32.164641 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 974/1963] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:30 2022] POST /compute/v2.1/servers => generated 214 bytes in 1969 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:01:32.271264 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f21b73a3-3121-4646-859d-eee1e7792e89 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.240582 Nov 02 13:01:32.283613 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 990/1964] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:01:32.299399 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-eedc3d1a-07d5-40cd-ae3c-da8ab6d5ce30 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:32.302670 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-eedc3d1a-07d5-40cd-ae3c-da8ab6d5ce30 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:32.620346 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-eedc3d1a-07d5-40cd-ae3c-da8ab6d5ce30 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:32.633095 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-eedc3d1a-07d5-40cd-ae3c-da8ab6d5ce30 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1214 microversion: 2.1 time: 0.338760 Nov 02 13:01:32.638535 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 975/1965] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:32 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:33.662389 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5e9affa1-aa8e-49f1-af0b-297ba821ffa7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:33.663812 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5e9affa1-aa8e-49f1-af0b-297ba821ffa7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:33.769056 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5e9affa1-aa8e-49f1-af0b-297ba821ffa7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:33.808643 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5e9affa1-aa8e-49f1-af0b-297ba821ffa7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1214 microversion: 2.1 time: 0.150676 Nov 02 13:01:33.834750 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 991/1966] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:33 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:34.842685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:34.843339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:34.860540 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:34.861046 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:34.861492 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:34.862227 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:34.876132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:34.878625 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:34.879290 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:34.880902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:34.882353 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:34.888467 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:34.888688 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:34.889358 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:34.890003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:35.016770 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-13abc23d-21e1-42e4-8edb-e358e69c5d2c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] 10.222.0.64 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.691041 Nov 02 13:01:35.028872 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 976/1967] 10.222.0.64 () {58 vars in 1185 bytes} [Wed Nov 2 13:01:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:35.167873 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:35.179608 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0d8f0809-96f1-4a0c-bef1-33a21308268f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1210 microversion: 2.1 time: 0.338403 Nov 02 13:01:35.180791 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 992/1968] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:34 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1210 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:35.243098 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1860754884", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "availability_zone": "nova:n-h2-857339-6", "networks": [{"uuid": "28d1d808-ac39-4cd1-8e45-5ed5c3ae902e"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:35.362354 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] validate_networks() for [('28d1d808-ac39-4cd1-8e45-5ed5c3ae902e', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:36.203896 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:36.204767 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:36.216257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:36.216768 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:36.217391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:36.218263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:36.218866 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:36.219436 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:36.415726 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:36.430710 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5e03659d-08ed-4aaf-aa1b-42af107f9cdb tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1274 microversion: 2.1 time: 0.230499 Nov 02 13:01:36.436205 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 993/1969] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:36 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-09567fed-5f7b-4f18-8362-48ba27d889fb) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:36.496987 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-09567fed-5f7b-4f18-8362-48ba27d889fb) Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Request method failure captured: Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 248 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmouniUHCN3q_dSfCDESqMyt9i8FkAfZA1UGLxtvRP3d1SF1Szk5TVJh1ZR4GsT1hDCwMig4tKeCQ5pb2Hdh_gccOGOQWATtdXtHToL4fpghDxxZYcSvv_4sKhwNXIKcO1zArlEDLt9v34au4HQC8nor5Xm98y_K6yjrm2xcKrlwk7M Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 83bd5e13a5e54740918cf5924a14886b Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestServerMultinode-113734434 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_83bd5e13a5e54740918cf5924a14886b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/83bd5e13a5e54740918cf5924a14886b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/83bd5e13a5e54740918cf5924a14886b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/83bd5e13a5e54740918cf5924a14886b"}]}] Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestServerMultinode-113734434 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 83bd5e13a5e54740918cf5924a14886b Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestServerMultinode-113734434 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestServerMultinode-113734434-project-admin Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: f75d319e5f924947bffd03b1d55affd2 Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestServerMultinode-113734434-project-admin Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestServerMultinode-server-1860754884", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "availability_zone": "nova:n-h2-857339-6", "networks": [{"uuid": "28d1d808-ac39-4cd1-8e45-5ed5c3ae902e"}]}} Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestServerMultinode-server-1860754884', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '28d1d808-ac39-4cd1-8e45-5ed5c3ae902e'}]}}} Nov 02 13:01:36.501038 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:36.507624 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-09567fed-5f7b-4f18-8362-48ba27d889fb) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-94565ee7-83d9-48b0-ace5-956e48c15f7c tempest-TestServerMultinode-113734434 tempest-TestServerMultinode-113734434-project-admin] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.259353 Nov 02 13:01:36.516088 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 977/1970] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:35 2022] POST /compute/v2.1/servers => generated 214 bytes in 1261 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:01:37.469833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:37.471052 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:37.483657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:37.484320 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:37.484954 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:37.490195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:37.490195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:37.490195 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:38.203530 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:38.216112 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fe8b2401-7c01-43fe-b255-34df5b5a129d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1272 microversion: 2.1 time: 0.747263 Nov 02 13:01:38.219513 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 994/1971] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:37 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1272 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:39.250189 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:39.251431 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:39.273575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:39.275847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:39.278250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:39.281304 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:39.282312 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:39.287377 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:39.894859 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:39.909976 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6d21a983-7433-441e-b562-d3b929877acd tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1272 microversion: 2.1 time: 0.664573 Nov 02 13:01:39.921206 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 978/1972] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:39 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1272 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:40.949647 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:40.950523 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:40.971112 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:40.974698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:40.975224 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:40.976063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:40.976563 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:40.977114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:41.283179 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:41.294734 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0f775690-dca8-433a-8d72-b3e99129726d tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1272 microversion: 2.1 time: 0.349892 Nov 02 13:01:41.314789 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 995/1973] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:40 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1272 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:42.334584 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:42.335911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:42.351243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:42.352008 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:42.352785 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:42.353762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:42.354440 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:42.356745 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:42.631201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:44.400014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:44.416988 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-793c4e7c-4b3d-4922-838e-ad80126739d7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 2.085968 Nov 02 13:01:44.442560 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 979/1974] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:42 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 2100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:45.449585 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:45.450206 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:45.474084 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:45.474887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=8 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:45.492670 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:45.494738 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:45.499985 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:45.503396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:45.517703 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:45.532686 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:46.475182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:46.492020 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-db2b312f-414b-458f-b13e-1f3021c2dbe5 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 1.046826 Nov 02 13:01:46.504040 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 996/1975] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:45 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:46.898088 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Action: 'create', calling method: .version_select at 0x7eff60843b80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2100756438", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVi3wmrvdWIylLgJin0IlAg3ZzNMVbF4qCi3a8QWVY4YqetLJprl02MG4sEMMM8jQVLJphykh0oGuWSio62ogW6NGNQSuchMi01NM+H2IWit81SGAKGLrctSgMvktIF7A=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:46.934324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:46.956600 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Getting quotas for project 859fa6a598e940adb04b27af754ebff8. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:01:46.976188 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Getting quotas for user bd516028846c4337ab3d9b3d8b18ac66 and project 859fa6a598e940adb04b27af754ebff8. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:01:47.010979 n-d-857339-6 devstack@n-api.service[127767]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] [f51b6b24-bf9e-443e-a82c-e072a7624599] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:01:47.535344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:47.535986 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:47.549679 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:47.550110 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:47.550555 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:47.551333 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:47.551808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:47.552249 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:48.030240 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] [f51b6b24-bf9e-443e-a82c-e072a7624599] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 37296. Nov 02 13:01:48.174981 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f6fe98a1-563d-4c7b-9379-080c15c7cbd3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.279806 Nov 02 13:01:48.180892 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 980/1976] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:01:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:48.192062 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74952fba-7171-4422-895b-bc9b5ae5ff12", "tag": "56afa1dd-972d-439d-a0d4-02b528292ceb"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:48.251507 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:48.253421 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:48.261443 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:48.292968 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] Creating event network-changed:56afa1dd-972d-439d-a0d4-02b528292ceb for instance 74952fba-7171-4422-895b-bc9b5ae5ff12 on n-h1-857339-6 Nov 02 13:01:48.351504 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-c15d57b5-7cd4-490b-998a-032e7004199f req-0f85af63-cf1b-4a4f-b6be-201a1dba1938 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167609 Nov 02 13:01:48.359103 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 981/1977] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:49.022917 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:49.044416 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d355cfe9-dd5b-4f9a-bfe4-3e32329f7669 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 1.511959 Nov 02 13:01:49.047439 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 997/1978] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:47 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:50.096388 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:50.097329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:50.110273 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:50.116944 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:50.117485 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:50.118436 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:50.119175 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:50.119603 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:50.703145 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:50.718788 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b9acbb5b-0d21-434b-b1cf-df07b2839653 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 0.626722 Nov 02 13:01:50.738708 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 982/1979] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:50 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:51.743904 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:51.745284 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:51.767379 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:51.768349 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:51.769135 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:51.772001 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:51.773247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:51.775688 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:52.572562 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:52.583651 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2c6c44c3-5fd3-4e00-8594-6132020c6177 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 0.843770 Nov 02 13:01:52.612698 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 998/1980] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:51 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:01:53.635545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:53.635545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:53.640135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:53.640683 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:53.641128 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:53.646010 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:53.653637 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:53.654148 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:55.248247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:55.269032 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-45de0ce1-f5b7-4b7c-9b2f-ff32bd4a1c24 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 1.659333 Nov 02 13:01:55.271462 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 983/1981] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:53 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:56.077084 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1231191917", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e2c151ab-6483-4838-bf46-12d1fa842cd2"}], "key_name": "tempest-TestNetworkBasicOps-2100756438", "security_groups": [{"name": "tempest-secgroup-smoke-822780518"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:56.295624 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:56.300081 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:56.307980 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:56.308537 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:56.308943 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:56.313198 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:56.317492 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:56.318111 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:56.807578 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] validate_networks() for [('e2c151ab-6483-4838-bf46-12d1fa842cd2', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:01:56.999711 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:01:57.886463 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:57.915199 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ff1c4461-45f8-4b76-851b-2900d6894607 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 1.612483 Nov 02 13:01:57.936183 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 984/1982] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:56 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:01:58.052777 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74952fba-7171-4422-895b-bc9b5ae5ff12", "name": "network-vif-plugged", "status": "completed", "tag": "56afa1dd-972d-439d-a0d4-02b528292ceb"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:01:58.089249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:58.090097 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:58.091909 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:58.132293 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] Creating event network-vif-plugged:56afa1dd-972d-439d-a0d4-02b528292ceb for instance 74952fba-7171-4422-895b-bc9b5ae5ff12 on n-h1-857339-6 Nov 02 13:01:58.163939 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-91c2b2fa-b8f9-491c-a98a-6f53667c7dbd req-0053dfa1-5b2a-4129-a374-125140835bae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116842 Nov 02 13:01:58.176082 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 985/1983] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95fc3014-3561-47e5-a85f-b289ee526ba2) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:58.271850 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95fc3014-3561-47e5-a85f-b289ee526ba2) Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Request method failure captured: Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 326 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmoXPeMCF0srqjpAHo35xZzvnkamCTRZ9uw9QLSXJtdSH-FtpZUL9qThbdN0zoLAsiJXxxR7pIHndvlAzfHaFnWezy90ERTIhgmC4p7Du__A8oMdKQKo29QvhKig-q6j_BxWTWI1aLN4dLEGxIxSPRdOGCU9gNp8bwsRZc9MlVdDIJ0 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 859fa6a598e940adb04b27af754ebff8 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkBasicOps-213837971 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_859fa6a598e940adb04b27af754ebff8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/859fa6a598e940adb04b27af754ebff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/859fa6a598e940adb04b27af754ebff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/859fa6a598e940adb04b27af754ebff8"}]}] Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkBasicOps-213837971 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 859fa6a598e940adb04b27af754ebff8 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkBasicOps-213837971 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkBasicOps-213837971-project Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: bd516028846c4337ab3d9b3d8b18ac66 Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkBasicOps-213837971-project Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1231191917", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e2c151ab-6483-4838-bf46-12d1fa842cd2"}], "key_name": "tempest-TestNetworkBasicOps-2100756438", "security_groups": [{"name": "tempest-secgroup-smoke-822780518"}]}} Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:58.289678 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1231191917', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'e2c151ab-6483-4838-bf46-12d1fa842cd2'}], 'key_name': 'tempest-TestNetworkBasicOps-2100756438', 'security_groups': [{'name': 'tempest-secgroup-smoke-822780518'}]}}} Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:01:58.301440 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-95fc3014-3561-47e5-a85f-b289ee526ba2) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57fc691e-a1eb-4eb7-b935-01649a1f7d1d tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 2.215105 Nov 02 13:01:58.314170 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 999/1984] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:01:56 2022] POST /compute/v2.1/servers => generated 214 bytes in 2217 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:01:58.957615 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:58.960324 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:01:58.976318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:58.979101 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:58.980090 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:58.980596 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:01:58.981800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:01:58.984585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:01:59.253447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0ba8c12f-d306-4b7c-8129-2f268e56280f tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Calling method '.version_select at 0x7eff5c732280>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:01:59.258745 n-d-857339-6 devstack@n-api.service[127766]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0ba8c12f-d306-4b7c-8129-2f268e56280f tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] [59d1c791-b280-467e-8982-42c3db1047f4] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:01:59.345205 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:01:59.360778 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-75e0c33f-c9aa-482f-b4f7-cc008dcbf0f3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 0.409127 Nov 02 13:01:59.366946 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 986/1985] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:01:58 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:00.273128 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [None req-0ba8c12f-d306-4b7c-8129-2f268e56280f tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] [59d1c791-b280-467e-8982-42c3db1047f4] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 37568. Nov 02 13:02:00.386840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:00.387469 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:00.398194 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:00.410343 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:00.412363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:00.413575 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:00.416031 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:00.418514 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:00.422494 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:00.453072 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0ba8c12f-d306-4b7c-8129-2f268e56280f tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2100756438" status: 202 len: 0 microversion: 2.1 time: 1.195654 Nov 02 13:02:00.453072 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1000/1986] 10.222.0.64 () {58 vars in 1257 bytes} [Wed Nov 2 13:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2100756438 => generated 0 bytes in 1202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:02:00.913390 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:00.926854 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8ff29cfa-8600-46f6-b7c4-f1665d9b63e3 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1314 microversion: 2.1 time: 0.544334 Nov 02 13:02:00.928367 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 987/1987] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:00 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:02:01.951665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:01.952582 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:01.964337 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:01.966623 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:01.968872 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:01.976184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:01.976184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:01.976184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:01.976184 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:01.983514 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=46 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:02.350692 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:02:02.369900 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9a6541de-18e2-43ee-947b-dd1f699bebff tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1462 microversion: 2.1 time: 0.416790 Nov 02 13:02:02.394584 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1001/1988] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:02:01 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1462 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:02:02.404736 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "069a38bc-6b72-40e1-999d-64010e87275b", "device": "/dev/sdb"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:02.419890 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:02:02.465955 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:02:02.482360 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=49 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:03.696719 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-78ddfae5-12e6-4ff0-95b2-50f30c658886 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "POST /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.296295 Nov 02 13:02:03.698108 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 988/1989] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Nov 2 13:02:02 2022] POST /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12/os-volume_attachments => generated 194 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:02:28.919580 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd7409fd-ec2d-4700-95df-0c2e0b270f48 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Action: 'create', calling method: .version_select at 0x7eff5c7f28b0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-596942199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFN8AQUnL79/gRfa41UtLwGRayuFIYZk8IrzloOcHnShRh8yHDcJRpLcu8EqvVQ8mIinvFF9cBFFz32hg2K0NmN5+mSFXctTfXeSscHOaOyJfuleHJ3Cu44zrIu6lv4cqA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:28.942963 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:02:28.943194 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:02:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 13:02:28.994228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-dd7409fd-ec2d-4700-95df-0c2e0b270f48 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Getting quotas for project 859fa6a598e940adb04b27af754ebff8. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:02:29.039247 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-dd7409fd-ec2d-4700-95df-0c2e0b270f48 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Getting quotas for user bd516028846c4337ab3d9b3d8b18ac66 and project 859fa6a598e940adb04b27af754ebff8. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:02:29.218756 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dd7409fd-ec2d-4700-95df-0c2e0b270f48 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.310617 Nov 02 13:02:29.219702 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1002/1990] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:02:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:02:36.721283 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 13:02:36.725543 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=3 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.727769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:02:36.737917 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1269210302", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f93ed399-0e31-4f6f-aa00-7845f1420975"}], "key_name": "tempest-TestNetworkBasicOps-596942199", "security_groups": [{"name": "tempest-secgroup-smoke-266418118"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:02:37.168223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] validate_networks() for [('f93ed399-0e31-4f6f-aa00-7845f1420975', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15f48c0a-353d-429d-b38e-d8ddb6f578c4) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:02:37.779109 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15f48c0a-353d-429d-b38e-d8ddb6f578c4) Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Request method failure captured: Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 325 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmoXPeMCF0srqjpAHo35xZzvnkamCTRZ9uw9QLSXJtdSH-FtpZUL9qThbdN0zoLAsiJXxxR7pIHndvlAzfHaFnWezy90ERTIhgmC4p7Du__A8oMdKQKo29QvhKig-q6j_BxWTWI1aLN4dLEGxIxSPRdOGCU9gNp8bwsRZc9MlVdDIJ0 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 859fa6a598e940adb04b27af754ebff8 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestNetworkBasicOps-213837971 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_859fa6a598e940adb04b27af754ebff8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/859fa6a598e940adb04b27af754ebff8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/859fa6a598e940adb04b27af754ebff8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/859fa6a598e940adb04b27af754ebff8"}]}] Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestNetworkBasicOps-213837971 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 859fa6a598e940adb04b27af754ebff8 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestNetworkBasicOps-213837971 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestNetworkBasicOps-213837971-project Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: bd516028846c4337ab3d9b3d8b18ac66 Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestNetworkBasicOps-213837971-project Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestNetworkBasicOps-server-1269210302", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "f93ed399-0e31-4f6f-aa00-7845f1420975"}], "key_name": "tempest-TestNetworkBasicOps-596942199", "security_groups": [{"name": "tempest-secgroup-smoke-266418118"}]}} Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:02:37.782889 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkBasicOps-server-1269210302', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'f93ed399-0e31-4f6f-aa00-7845f1420975'}], 'key_name': 'tempest-TestNetworkBasicOps-596942199', 'security_groups': [{'name': 'tempest-secgroup-smoke-266418118'}]}}} Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:02:37.786169 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-15f48c0a-353d-429d-b38e-d8ddb6f578c4) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8ef0b99c-c9be-4d05-a6ae-c29e3a379869 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.071274 Nov 02 13:02:37.792272 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 989/1991] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:02:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 1085 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:02:38.253401 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-39a616c7-276c-46fc-ae0d-044bc06247b3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] Calling method '.version_select at 0x7eff5c18e5e0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:02:38.437456 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-39a616c7-276c-46fc-ae0d-044bc06247b3 tempest-TestNetworkBasicOps-213837971 tempest-TestNetworkBasicOps-213837971-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-596942199" status: 202 len: 0 microversion: 2.1 time: 0.186101 Nov 02 13:02:38.437456 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1003/1992] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 13:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-596942199 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:03:09.001011 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:09.390153 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3c3a7bc1-e73c-428e-a055-5d7a86fca20c tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Action: 'create', calling method: .version_select at 0x7eff5c6cfb80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1064380419", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcQ8B5LgybvbniC2vYRz9Hiy5lr+jm+G2pVNgijYV9KliIyYcuKUXPs7yCFdAEK5iVOxZyROsR2Ba6d5zMPzZLxHfEEBpJUGVhVX8czZZpVaxq8qdJZVso7esxGpC1TUQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:09.438223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-3c3a7bc1-e73c-428e-a055-5d7a86fca20c tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Getting quotas for project 1ac4313709954b2e9e651cb26814df74. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:03:09.452418 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-3c3a7bc1-e73c-428e-a055-5d7a86fca20c tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Getting quotas for user a1be68d931534659a269ae57717e47d2 and project 1ac4313709954b2e9e651cb26814df74. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:03:09.608230 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3c3a7bc1-e73c-428e-a055-5d7a86fca20c tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.610762 Nov 02 13:03:09.610418 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 990/1993] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:03:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:14.457804 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=5 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:14.458675 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:14.464780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1904147024", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1064380419", "security_groups": [{"name": "tempest-secgroup-smoke-1492423060"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e67f1afc-5b32-4d76-832d-1f33841aa5a5"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:14.622829 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] validate_networks() for [('e67f1afc-5b32-4d76-832d-1f33841aa5a5', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4fe3271c-211a-4a81-b56b-83639e7a23d4) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:03:15.215864 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4fe3271c-211a-4a81-b56b-83639e7a23d4) Nov 02 13:03:15.220441 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.230743 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:03:15.230743 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Request method failure captured: Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 415 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmp6N6tBIW9vGiS_vueenw_Of3DtsHQsYXvkfeWovM_2-5fXM5s9KbV6hWE3Hcd4S0vVvXEupZvkGzQEpcz1q7VocsNjpbvOrsammAoxnTGaqF5yeR-htibnY4Wbq79UjCt5wgPY-Sknp-k8R-tvAwgQMTwnOvjGbfX2HGAB5jzd23k Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 1ac4313709954b2e9e651cb26814df74 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestServerBasicOps-412584199 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1ac4313709954b2e9e651cb26814df74", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1ac4313709954b2e9e651cb26814df74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1ac4313709954b2e9e651cb26814df74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1ac4313709954b2e9e651cb26814df74"}]}] Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestServerBasicOps-412584199 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 1ac4313709954b2e9e651cb26814df74 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestServerBasicOps-412584199 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestServerBasicOps-412584199-project Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: a1be68d931534659a269ae57717e47d2 Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestServerBasicOps-412584199-project Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestServerBasicOps-server-1904147024", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1064380419", "security_groups": [{"name": "tempest-secgroup-smoke-1492423060"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e67f1afc-5b32-4d76-832d-1f33841aa5a5"}]}} Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestServerBasicOps-server-1904147024', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestServerBasicOps-1064380419', 'security_groups': [{'name': 'tempest-secgroup-smoke-1492423060'}], 'config_drive': True, 'metadata': {'meta1': 'data1', 'meta2': 'data2', 'metaN': 'dataN'}, 'networks': [{'uuid': 'e67f1afc-5b32-4d76-832d-1f33841aa5a5'}]}}} Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:03:15.246785 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4fe3271c-211a-4a81-b56b-83639e7a23d4) Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:03:15.250772 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.254603 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:03:15.261097 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:03:15.261097 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:03:15.262764 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-79b519a9-71f8-4270-ac88-815350060124 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.805661 Nov 02 13:03:15.264644 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1004/1994] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:03:14 2022] POST /compute/v2.1/servers => generated 214 bytes in 808 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:03:15.674703 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8895dcd3-9442-49a7-963b-7c7ec5884317 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] Calling method '.version_select at 0x7eff606f69d0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:15.822621 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8895dcd3-9442-49a7-963b-7c7ec5884317 tempest-TestServerBasicOps-412584199 tempest-TestServerBasicOps-412584199-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1064380419" status: 202 len: 0 microversion: 2.1 time: 0.153631 Nov 02 13:03:15.823832 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 991/1995] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 13:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1064380419 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:03:54.215650 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:54.458312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ed9f9873-8832-4cc3-af9f-ab80f2e6384f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-793949110", "availability_zone": "foo_zone"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:54.478992 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.aggregate [None req-ed9f9873-8832-4cc3-af9f-ab80f2e6384f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Generated uuid da7e24d6-f096-4e94-81af-55ca857e18fd for aggregate {{(pid=127766) create /opt/stack/nova/nova/objects/aggregate.py:298}} Nov 02 13:03:54.616265 n-d-857339-6 devstack@n-api.service[127766]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ed9f9873-8832-4cc3-af9f-ab80f2e6384f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] [90697310-1f61-4d9e-8bf9-005958e1ce95] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:03:55.626195 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [None req-ed9f9873-8832-4cc3-af9f-ab80f2e6384f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] [90697310-1f61-4d9e-8bf9-005958e1ce95] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 40084. Nov 02 13:03:55.631781 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ed9f9873-8832-4cc3-af9f-ab80f2e6384f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 1.422765 Nov 02 13:03:55.632970 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1005/1996] 10.222.0.64 () {60 vars in 1164 bytes} [Wed Nov 2 13:03:54 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:55.643117 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:55.644612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:03:55.649099 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b10b9813-b2f0-4b30-9f69-eb63863bbed8 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:55.815139 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b10b9813-b2f0-4b30-9f69-eb63863bbed8 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.174073 Nov 02 13:03:55.825441 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 992/1997] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 13:03:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:55.831487 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.841318 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.858213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.858213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.858213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.858213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:55.858213 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:55.912535 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-94c53199-316b-44e7-be7c-cc8f67a62280 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.085615 Nov 02 13:03:55.915424 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1006/1998] 10.222.0.64 () {58 vars in 1176 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:55.926278 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3ce5690c-f917-4818-a68e-a8d56b9f3eee tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:55.939540 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3ce5690c-f917-4818-a68e-a8d56b9f3eee tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.017719 Nov 02 13:03:55.953275 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 993/1999] 10.222.0.64 () {58 vars in 1143 bytes} [Wed Nov 2 13:03:55 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:55.960516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7d9a1012-4d1b-450e-ad75-6a307979a54b tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-857339-6"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:55.996178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d9a1012-4d1b-450e-ad75-6a307979a54b tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:55.997053 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d9a1012-4d1b-450e-ad75-6a307979a54b tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:56.001693 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7d9a1012-4d1b-450e-ad75-6a307979a54b tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:56.715900 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7d9a1012-4d1b-450e-ad75-6a307979a54b tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.760463 Nov 02 13:03:56.722438 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1007/2000] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 13:03:55 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:03:56.739572 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4bcb1066-3cec-469a-a2fc-3c4e6966ac3f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:56.753697 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4bcb1066-3cec-469a-a2fc-3c4e6966ac3f tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.024157 Nov 02 13:03:56.756478 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 994/2001] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 13:03:56 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:56.768537 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-85d997ff-a4f6-491e-9a3a-c26709680e66 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1170101715", "availability_zone": "foo_zone"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:57.165090 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-85d997ff-a4f6-491e-9a3a-c26709680e66 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.400185 Nov 02 13:03:57.180473 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1008/2002] 10.222.0.64 () {60 vars in 1173 bytes} [Wed Nov 2 13:03:56 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:57.186881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-aa3dda41-75d6-4889-b6e6-203318b63f68 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:57.320461 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-aa3dda41-75d6-4889-b6e6-203318b63f68 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.136492 Nov 02 13:03:57.331535 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 995/2003] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 13:03:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:57.342964 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ca325c11-924d-44b2-b7dc-1e7d42938c96 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:57.354964 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ca325c11-924d-44b2-b7dc-1e7d42938c96 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.024992 Nov 02 13:03:57.363387 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1009/2004] 10.222.0.64 () {58 vars in 1152 bytes} [Wed Nov 2 13:03:57 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:03:57.370102 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-a565b02b-34e2-4ff0-ab9c-d38ab2a6f10a tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-857339-6"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:03:57.382983 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a565b02b-34e2-4ff0-ab9c-d38ab2a6f10a tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:03:57.386488 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a565b02b-34e2-4ff0-ab9c-d38ab2a6f10a tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:03:57.387773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-a565b02b-34e2-4ff0-ab9c-d38ab2a6f10a tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:03:58.070244 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-a565b02b-34e2-4ff0-ab9c-d38ab2a6f10a tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.705742 Nov 02 13:03:58.075591 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 996/2005] 10.222.0.64 () {60 vars in 1194 bytes} [Wed Nov 2 13:03:57 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:03:58.086539 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aec953fd-63f7-4241-b59e-8d9db6a06b20 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:03:58.235791 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aec953fd-63f7-4241-b59e-8d9db6a06b20 tempest-TestAggregatesBasicOps-2028640344 tempest-TestAggregatesBasicOps-2028640344-project-admin] 10.222.0.64 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.154678 Nov 02 13:03:58.242228 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1010/2006] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Nov 2 13:03:58 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Nov 02 13:04:21.258107 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:21.259048 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:21.600724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4a6512bd-e551-4a6e-b27c-d6e917984bd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: .version_select at 0x7eff60705670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1568022865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILYpXuoVlP+XxiZZ8J4wCtqZLOigKa4LFmEowRhfix4wnaad7w4SYoFC8YsqLmkwSxplSpOkZZnh9cgVVg8IXr/I56Bg3myIjkHddpfruVRH/yqUKs79HZvC8ZyAXPyFA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:21.623053 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4a6512bd-e551-4a6e-b27c-d6e917984bd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:21.629280 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-4a6512bd-e551-4a6e-b27c-d6e917984bd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for user 62451d7dd91d4a719549e29e3b7e1aab and project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:21.804214 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4a6512bd-e551-4a6e-b27c-d6e917984bd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.545593 Nov 02 13:04:21.804214 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 997/2007] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:04:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:40.671099 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:40.672625 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=6 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:40.673808 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:40.684427 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-118955865", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c4516824-9d19-438d-bd0c-76f5902d347f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1568022865", "security_groups": [{"name": "tempest-secgroup-smoke-1330858479"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:41.873475 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] validate_networks() for [('c4516824-9d19-438d-bd0c-76f5902d347f', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39eb0156-1055-4eb7-8a6b-1bd9f65da783) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:04:42.278552 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39eb0156-1055-4eb7-8a6b-1bd9f65da783) Nov 02 13:04:42.283812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.288679 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:42.288679 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Request method failure captured: Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 344 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmrTgngn3GHwUrun1RoX8ZljiDp06yIPqJ0QFkQdoI0VeehgdNQMj3qvRhBoa0RBYiwqcVNkTLtw-8Zxg-f83U9nrKjqMTV1SnnGnMrssL9BTHYtHqMsjwApWe-sb8VuyB14SQe8CElw_2ePBPg3nyyCe5Hpj7JcjKZrQAqYl7Qkdrc Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_61491c06413d4385afd9e7f35b7026df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}] Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 62451d7dd91d4a719549e29e3b7e1aab Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-118955865", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "c4516824-9d19-438d-bd0c-76f5902d347f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1568022865", "security_groups": [{"name": "tempest-secgroup-smoke-1330858479"}]}} Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-118955865', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'c4516824-9d19-438d-bd0c-76f5902d347f'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1568022865', 'security_groups': [{'name': 'tempest-secgroup-smoke-1330858479'}]}}} Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:04:42.302107 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-39eb0156-1055-4eb7-8a6b-1bd9f65da783) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:04:42.307066 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f9be6382-1ea6-446d-9ef0-a7692b0edcd9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.633296 Nov 02 13:04:42.318237 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1011/2008] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:04:40 2022] POST /compute/v2.1/servers => generated 214 bytes in 1639 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:04:47.504002 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:04:47.516848 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:47.539445 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:47.555219 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.561329 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.562733 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:47.565653 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:47.566312 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:47.567918 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:48.378889 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lazy-loading 'services' on Instance uuid 74952fba-7171-4422-895b-bc9b5ae5ff12 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:04:48.956374 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-265347fd-267c-49be-859f-c44bb036a89f tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12/os-volume_attachments/069a38bc-6b72-40e1-999d-64010e87275b" status: 202 len: 0 microversion: 2.1 time: 1.462645 Nov 02 13:04:48.960469 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 998/2009] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Nov 2 13:04:47 2022] DELETE /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12/os-volume_attachments/069a38bc-6b72-40e1-999d-64010e87275b => generated 0 bytes in 1465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:50.479081 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-45273564-b794-49e1-bc24-2636cf3790b9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Calling method '.version_select at 0x7eff5c214940>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:50.597799 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-45273564-b794-49e1-bc24-2636cf3790b9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1568022865" status: 202 len: 0 microversion: 2.1 time: 0.122649 Nov 02 13:04:50.598435 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1012/2010] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:04:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1568022865 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:04:50.615166 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-546f2fba-3b3c-4f87-929c-c5f41df71b32 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: .version_select at 0x7eff5c45a0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-847924765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpyp2sK9w+yICJF818qH+xoT8I8jOCDnwnJjLDe1z1fcKG0GNwSwsiHb4et/5B362ue0rjgQcoSwHFHKiGUn9943CXbigbFKmq1oXfMnpTqF6RMLQvAasFhmpIGHiItRA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:50.633802 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-546f2fba-3b3c-4f87-929c-c5f41df71b32 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:04:50.640867 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-546f2fba-3b3c-4f87-929c-c5f41df71b32 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for user 62451d7dd91d4a719549e29e3b7e1aab and project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:04:51.055422 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-546f2fba-3b3c-4f87-929c-c5f41df71b32 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.445673 Nov 02 13:04:51.065021 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 999/2011] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:04:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:04:51.145461 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-986341888", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b1f4ce38-9981-4710-bdb9-991253efada3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:04:51.430743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] validate_networks() for [('b0d06de6-8a85-43bf-b702-e79f29361025', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd998273-b741-4e30-a67f-b01008429fb2) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:04:51.883611 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd998273-b741-4e30-a67f-b01008429fb2) Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:51.890555 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Request method failure captured: Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 353 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmrcCYydjoQKiKIu-QMS0rGwZ8yJWsm-m4G7ihDfAXVNHWflCFf65QnX90Ex7YLf_Kw_e5zVI9QWCBsiYC42yqPOo5Qj7vDi8ujjCIF46TNK2fjanlQyUMlteDpkz0EsHAWAoaPuXB3bBRn21OGvCAOBOLqzqU1LYJbTJj0-tv8RGKY Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a42e2f895074311ba70e12d1b5eaeba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}] Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 948c29a5d95c4ae1b44b3760eec4b344 Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestVolumeBootPattern-server-986341888", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b1f4ce38-9981-4710-bdb9-991253efada3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-986341888', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'b1f4ce38-9981-4710-bdb9-991253efada3'}], 'networks': [{'uuid': 'b0d06de6-8a85-43bf-b702-e79f29361025'}]}}} Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:04:51.895069 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-dd998273-b741-4e30-a67f-b01008429fb2) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:04:51.899781 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:04:51.910048 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:04:51.914827 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1f34e566-c629-4c31-8fde-b32afc21f7fe tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.765881 Nov 02 13:04:51.916451 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1013/2012] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:04:51 2022] POST /compute/v2.1/servers => generated 214 bytes in 776 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:04:58.516143 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:58.517223 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:58.528231 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:58.529573 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:58.530016 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:58.531073 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:58.531529 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:58.531952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:58.569929 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:04:59.000704 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4fa5865f-e3fe-44a5-9a90-0f3c71cf9318 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 204 len: 0 microversion: 2.1 time: 0.493696 Nov 02 13:04:59.002787 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1000/2013] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 13:04:58 2022] DELETE /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:04:59.017843 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:04:59.018462 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:04:59.040768 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.041288 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.041778 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.043057 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:04:59.043521 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:04:59.043947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:04:59.453239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:04:59.465356 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-518db0d8-a4a5-4ceb-83e2-752f89398f78 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1468 microversion: 2.1 time: 0.448678 Nov 02 13:04:59.468915 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1014/2014] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:04:59 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:00.494036 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:00.494668 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:00.501782 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:00.518511 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:00.523673 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:00.524375 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:00.524905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:00.531620 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:00.652337 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:00.826409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:00.836237 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5fba5fea-c83c-4231-9c10-61b53216d5b7 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1468 microversion: 2.1 time: 0.347001 Nov 02 13:05:00.837443 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1001/2015] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:00 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1468 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:01.887281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:01.887281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:02.002856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:02.004162 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-460783570", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6e9faf0e-ffb5-4ebb-978c-428bf45c03df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:02.214840 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] validate_networks() for [('b0d06de6-8a85-43bf-b702-e79f29361025', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:02.966323 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:03.003762 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-49ad8a27-e38d-410e-b3b8-52abcfe31ac8 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1468 microversion: 2.1 time: 1.143797 Nov 02 13:05:03.010659 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1015/2016] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:01 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1468 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64d918ab-1492-43bd-a77d-84d1b2dc1808) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:03.339444 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64d918ab-1492-43bd-a77d-84d1b2dc1808) Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Request method failure captured: Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 353 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmrcCYydjoQKiKIu-QMS0rGwZ8yJWsm-m4G7ihDfAXVNHWflCFf65QnX90Ex7YLf_Kw_e5zVI9QWCBsiYC42yqPOo5Qj7vDi8ujjCIF46TNK2fjanlQyUMlteDpkz0EsHAWAoaPuXB3bBRn21OGvCAOBOLqzqU1LYJbTJj0-tv8RGKY Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a42e2f895074311ba70e12d1b5eaeba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}] Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 948c29a5d95c4ae1b44b3760eec4b344 Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestVolumeBootPattern-server-460783570", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6e9faf0e-ffb5-4ebb-978c-428bf45c03df", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:03.344791 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-460783570', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '6e9faf0e-ffb5-4ebb-978c-428bf45c03df'}], 'networks': [{'uuid': 'b0d06de6-8a85-43bf-b702-e79f29361025'}]}}} Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:03.349488 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-64d918ab-1492-43bd-a77d-84d1b2dc1808) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:03.353247 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2caf6919-29ae-4c21-95f9-6904b7a522f6 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.365549 Nov 02 13:05:03.360039 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1002/2017] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 1374 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:05:03.552791 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74952fba-7171-4422-895b-bc9b5ae5ff12", "name": "network-vif-deleted", "tag": "56afa1dd-972d-439d-a0d4-02b528292ceb"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:03.577078 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:03.577815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:03.578459 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:03.615273 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] Creating event network-vif-deleted:56afa1dd-972d-439d-a0d4-02b528292ceb for instance 74952fba-7171-4422-895b-bc9b5ae5ff12 on n-h1-857339-6 Nov 02 13:05:03.632303 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-87a3d546-4c80-4fd2-96a9-e5ea6313da13 req-066a47c4-ec79-41d6-863f-3148610d97ee service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082367 Nov 02 13:05:03.633332 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1016/2018] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:04.057896 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:04.058847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:04.116699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.117620 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.132112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.139196 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.143262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.150499 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.290883 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:04.293318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:04.294389 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:04.295612 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.objects.instance [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lazy-loading 'fault' on Instance uuid 74952fba-7171-4422-895b-bc9b5ae5ff12 {{(pid=127767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:05:04.394547 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:04.429958 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b806b577-66c4-4a22-a5f1-19156405e0b9 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1304 microversion: 2.1 time: 0.373029 Nov 02 13:05:04.436347 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1003/2019] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:04 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1304 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:05.489378 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:05.491726 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:05.507182 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.509344 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.511203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.513428 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.514500 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.515538 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.610514 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:05.613355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:05.615376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:05.618371 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.objects.instance [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lazy-loading 'fault' on Instance uuid 74952fba-7171-4422-895b-bc9b5ae5ff12 {{(pid=127766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 13:05:05.773645 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc554a51c084c45805c44333f345b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34bf3744309d4381acf25152b0225203', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:05:05.793059 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-86c79291-5091-4e52-bc83-1aa11bd6fdc2 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 200 len: 1304 microversion: 2.1 time: 0.319425 Nov 02 13:05:05.794433 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1017/2020] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:05 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 1304 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:05:06.824238 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:06.825000 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] [instance: 74952fba-7171-4422-895b-bc9b5ae5ff12] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:05:06.831958 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:06.833055 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:06.845250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:06.846395 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:05:06.847351 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:05:06.848266 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:05:06.865004 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] HTTP exception thrown: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Request method failure captured: Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: request: GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 HTTP/1.1 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 0 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmoknfpMmPFWW9M4YXgZSarlxg4YlRM5hhaYpZ3bsdsyJFX6UJ495uAYzYfCEUTv0iCrdR36IbA_EzhDA6khuaUF2xDJW2YZm7kxNLhUFnqXtOTg9dgN4DZiOAY-yAyExVHwk5od_6YJ8kssOKWUVz5kVUyjrENUCWuY1Xd7z0Tmw3g Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 34bf3744309d4381acf25152b0225203 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-VolumesBackupsTest-36099774 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_34bf3744309d4381acf25152b0225203", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34bf3744309d4381acf25152b0225203"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/34bf3744309d4381acf25152b0225203"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34bf3744309d4381acf25152b0225203"}]}] Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-VolumesBackupsTest-36099774 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 34bf3744309d4381acf25152b0225203 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-VolumesBackupsTest-36099774 Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-VolumesBackupsTest-36099774-project Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: cfc554a51c084c45805c44333f345b8d Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-VolumesBackupsTest-36099774-project Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: exception: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': '74952fba-7171-4422-895b-bc9b5ae5ff12'} Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:06.866860 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. Nov 02 13:05:06.871021 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:06.873035 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] Returning 404 to user: Instance 74952fba-7171-4422-895b-bc9b5ae5ff12 could not be found. {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:06.873999 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-86a3e31e-1b90-479b-844e-5e1420719172 tempest-VolumesBackupsTest-36099774 tempest-VolumesBackupsTest-36099774-project] 10.222.0.64 "GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12" status: 404 len: 111 microversion: 2.1 time: 0.054278 Nov 02 13:05:06.874663 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1004/2021] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:05:06 2022] GET /compute/v2.1/servers/74952fba-7171-4422-895b-bc9b5ae5ff12 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 13:05:08.566743 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1986420476", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e0d8c42f-8664-4025-8a4d-4f93b62d15ca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-847924765", "security_groups": [{"name": "tempest-secgroup-smoke-1793872401"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:08.798151 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] validate_networks() for [('e0d8c42f-8664-4025-8a4d-4f93b62d15ca', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:09.190709 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0) Nov 02 13:05:09.197550 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.202084 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:09.202084 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Request method failure captured: Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 344 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmrTgngn3GHwUrun1RoX8ZljiDp06yIPqJ0QFkQdoI0VeehgdNQMj3qvRhBoa0RBYiwqcVNkTLtw-8Zxg-f83U9nrKjqMTV1SnnGnMrssL9BTHYtHqMsjwApWe-sb8VuyB14SQe8CElw_2ePBPg3nyyCe5Hpj7JcjKZrQAqYl7Qkdrc Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_61491c06413d4385afd9e7f35b7026df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}] Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 62451d7dd91d4a719549e29e3b7e1aab Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1986420476", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "e0d8c42f-8664-4025-8a4d-4f93b62d15ca"}], "key_name": "tempest-TestNetworkAdvancedServerOps-847924765", "security_groups": [{"name": "tempest-secgroup-smoke-1793872401"}]}} Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1986420476', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'e0d8c42f-8664-4025-8a4d-4f93b62d15ca'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-847924765', 'security_groups': [{'name': 'tempest-secgroup-smoke-1793872401'}]}}} Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:09.204331 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cff9ef44-bff1-402c-9d8c-2c06be01c4a0) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.208995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.213144 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:09.221782 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:09.221782 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:09.226690 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-79a35fbf-3030-4193-92fa-fb059bdb697f tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.667537 Nov 02 13:05:09.230951 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1018/2022] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 677 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:05:18.749160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-56740a5b-d61a-4ae3-822a-e5cb08162def tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Calling method '.version_select at 0x7eff607304c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:18.762654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:18.764930 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:18.929233 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-56740a5b-d61a-4ae3-822a-e5cb08162def tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-847924765" status: 202 len: 0 microversion: 2.1 time: 0.195735 Nov 02 13:05:18.930492 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1005/2023] 10.222.0.64 () {58 vars in 1281 bytes} [Wed Nov 2 13:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-847924765 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:05:18.943792 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=22 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:18.949246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1b4b6845-76e6-4d82-8769-8a3f01069a92 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: .version_select at 0x7eff5c18e820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1638207584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/WXcj46D0EwpeYBfZk6LwI4o31UnaMMRGOkL61P3G2ILoKuo/mWZXbO90BYJwZtRv1wk+FQ2iq1yqs57dnKSkHTZEh86HOVHYcyFqiuvAqtK8BwN+eW09ebkMUrkpysw=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:18.979504 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1b4b6845-76e6-4d82-8769-8a3f01069a92 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:18.988188 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-1b4b6845-76e6-4d82-8769-8a3f01069a92 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for user 62451d7dd91d4a719549e29e3b7e1aab and project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:19.124998 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1b4b6845-76e6-4d82-8769-8a3f01069a92 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.181727 Nov 02 13:05:19.131350 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1019/2024] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:05:18 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:38.714268 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-856532534", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "82733eab-2f7a-4447-8368-8b7351adc0c3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1638207584", "security_groups": [{"name": "tempest-secgroup-smoke-62659489"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:45.388055 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:45.390771 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:05:45.400387 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1641988572", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "04f366de-d02a-4935-bd2f-85b59c4c58cf"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:46.787867 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] validate_networks() for [('04f366de-d02a-4935-bd2f-85b59c4c58cf', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:46.915760 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] validate_networks() for [('82733eab-2f7a-4447-8368-8b7351adc0c3', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72cf37fb-0b7c-44de-b748-9d84d79e6639) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:47.376099 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72cf37fb-0b7c-44de-b748-9d84d79e6639) Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Request method failure captured: Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 206 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmslzVUS4ULJx6sv3SBUv7Dbe8TDoxH0L8vaxc2F95Q3jVEi_G7y7jvIr0Zhhz1CcZE5uHrVgX2UvXNJLrfHrSNdbk_qOr5SX1bBUJUUm1P3PTlgWkCT1oCcTmTaLKyzcUDZKUiwHxTCORCV8ZtT3FwmDHg5bmRVhx4PNYW3nDl0gDM Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 265437565d7341439bc5263a1291fb2b Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_265437565d7341439bc5263a1291fb2b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/265437565d7341439bc5263a1291fb2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/265437565d7341439bc5263a1291fb2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/265437565d7341439bc5263a1291fb2b"}]}] Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 265437565d7341439bc5263a1291fb2b Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesActionsTest-1488423757-project Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ad70fb3b226f4873805138a965673672 Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesActionsTest-1488423757-project Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-VolumesActionsTest-instance-1641988572", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "04f366de-d02a-4935-bd2f-85b59c4c58cf"}]}} Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-1641988572', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '04f366de-d02a-4935-bd2f-85b59c4c58cf'}]}}} Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:47.390855 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:47.410717 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-72cf37fb-0b7c-44de-b748-9d84d79e6639) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-11677c3e-92be-4cf7-ad4c-c7645beaabf3 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.991095 Nov 02 13:05:47.424947 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1020/2025] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:45 2022] POST /compute/v2.1/servers => generated 214 bytes in 1993 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-70cd4453-8f99-4025-9311-164ee2ff4b4d) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:47.511165 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-70cd4453-8f99-4025-9311-164ee2ff4b4d) Nov 02 13:05:47.515231 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.516937 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.516937 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Request method failure captured: Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 342 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmrTgngn3GHwUrun1RoX8ZljiDp06yIPqJ0QFkQdoI0VeehgdNQMj3qvRhBoa0RBYiwqcVNkTLtw-8Zxg-f83U9nrKjqMTV1SnnGnMrssL9BTHYtHqMsjwApWe-sb8VuyB14SQe8CElw_2ePBPg3nyyCe5Hpj7JcjKZrQAqYl7Qkdrc Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_61491c06413d4385afd9e7f35b7026df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}] Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 62451d7dd91d4a719549e29e3b7e1aab Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-856532534", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "82733eab-2f7a-4447-8368-8b7351adc0c3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1638207584", "security_groups": [{"name": "tempest-secgroup-smoke-62659489"}]}} Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-856532534', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '82733eab-2f7a-4447-8368-8b7351adc0c3'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1638207584', 'security_groups': [{'name': 'tempest-secgroup-smoke-62659489'}]}}} Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:47.519538 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-70cd4453-8f99-4025-9311-164ee2ff4b4d) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:47.523918 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.528413 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:47.531211 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-70b13b63-8a59-4788-a501-9f99a9ae4f08 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 8.827611 Nov 02 13:05:47.535678 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1006/2026] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 8834 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:05:47.541695 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-251712536", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "04f366de-d02a-4935-bd2f-85b59c4c58cf"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:47.694823 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] validate_networks() for [('04f366de-d02a-4935-bd2f-85b59c4c58cf', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9314838d-cddd-4603-970c-70a0659897ef) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:47.987235 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9314838d-cddd-4603-970c-70a0659897ef) Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Request method failure captured: Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 205 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmslzVUS4ULJx6sv3SBUv7Dbe8TDoxH0L8vaxc2F95Q3jVEi_G7y7jvIr0Zhhz1CcZE5uHrVgX2UvXNJLrfHrSNdbk_qOr5SX1bBUJUUm1P3PTlgWkCT1oCcTmTaLKyzcUDZKUiwHxTCORCV8ZtT3FwmDHg5bmRVhx4PNYW3nDl0gDM Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 265437565d7341439bc5263a1291fb2b Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_265437565d7341439bc5263a1291fb2b", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/265437565d7341439bc5263a1291fb2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/265437565d7341439bc5263a1291fb2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/265437565d7341439bc5263a1291fb2b"}]}] Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 265437565d7341439bc5263a1291fb2b Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-VolumesActionsTest-1488423757 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-VolumesActionsTest-1488423757-project Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ad70fb3b226f4873805138a965673672 Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-VolumesActionsTest-1488423757-project Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-VolumesActionsTest-instance-251712536", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "04f366de-d02a-4935-bd2f-85b59c4c58cf"}]}} Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-VolumesActionsTest-instance-251712536', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '04f366de-d02a-4935-bd2f-85b59c4c58cf'}]}}} Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:47.995535 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:48.011028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9314838d-cddd-4603-970c-70a0659897ef) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-50a6dce0-b62b-4173-93ce-a1d8128eba02 tempest-VolumesActionsTest-1488423757 tempest-VolumesActionsTest-1488423757-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.488016 Nov 02 13:05:48.022281 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1021/2027] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:47 2022] POST /compute/v2.1/servers => generated 214 bytes in 492 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 13:05:50.723995 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5fa213d5-8999-4314-b5c5-56151119ed8e tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Action: 'create', calling method: .version_select at 0x7eff60776dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1582104068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5uVAsjKyjhiLjchUPa0sTgrFUufjN0x0gOI6q5TmhlHksNjJq9F9SCKc1bcLm/aPE7sy4fm5d1veNO8s36OzrrTaVjbM+HO2fuXEOsrwLNHUg5lIryo2zK0sgdcRbU/Q=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:50.752103 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5fa213d5-8999-4314-b5c5-56151119ed8e tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Getting quotas for project 9aa48be6894b4a5993e969472afe1396. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:50.762700 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-5fa213d5-8999-4314-b5c5-56151119ed8e tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Getting quotas for user 10227f104b254a91b4f14e9818244d7d and project 9aa48be6894b4a5993e969472afe1396. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:51.382262 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5fa213d5-8999-4314-b5c5-56151119ed8e tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.677387 Nov 02 13:05:51.382899 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1007/2028] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:05:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:05:56.607178 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cac05804-780b-4103-9bbd-c5af861b952e tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Calling method '.version_select at 0x7eff5c5c24c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:05:56.811843 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cac05804-780b-4103-9bbd-c5af861b952e tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1638207584" status: 202 len: 0 microversion: 2.1 time: 0.250110 Nov 02 13:05:56.812518 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1022/2029] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1638207584 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:05:56.835157 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-2330e576-11d0-4c5b-9958-f759f5dc13dd tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: .version_select at 0x7eff60776a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1033182023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInwTjwNst/DywU4bQQeKXChn+jfBRg3rSpX9XfCCBv0vKF7u+ZmGJXmVhvIuvnCgA8Qqm4HvEQpGHpoZs3a6ctmjkHRlTA7R87MCOJTBBnt4jUeUyMkPzI5KyKWLdfuoQ=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:56.885087 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2330e576-11d0-4c5b-9958-f759f5dc13dd tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:05:56.900478 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-2330e576-11d0-4c5b-9958-f759f5dc13dd tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Getting quotas for user 62451d7dd91d4a719549e29e3b7e1aab and project 61491c06413d4385afd9e7f35b7026df. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:05:57.071549 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-2330e576-11d0-4c5b-9958-f759f5dc13dd tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.242239 Nov 02 13:05:57.073370 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1008/2030] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:05:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:05:58.460607 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1833878766", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "37a571d0-8dac-4cf2-b1bc-1c9fd045c744", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1582104068", "security_groups": [{"name": "tempest-secgroup-smoke-2056140851"}], "networks": [{"uuid": "1cb2267c-fc9d-44d7-becd-01e5adf06201"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:05:59.049786 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] validate_networks() for [('1cb2267c-fc9d-44d7-becd-01e5adf06201', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa367b7d-2e10-4af5-aea9-81551fdee262) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:59.796790 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa367b7d-2e10-4af5-aea9-81551fdee262) Nov 02 13:05:59.803309 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.806654 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:59.806654 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Request method failure captured: Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 450 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmnz9zLHy6HaSZyZt6i6o9x8d_RrBaGG7OXu08Bkcx5ANnMHZniEU5djsKUXbYn32UGKS8f65UqouZQKkB3vLIvgpbdSZ5etXojbqp3QiRmhiV1NSiY4t90FGMSCA6OX_hT9nRIEpO5cd5mUNrR_wMtfGMkZxG7YS9phXeqzkbJyLhE Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9aa48be6894b4a5993e969472afe1396 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestVolumeBackupRestore-307099772 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9aa48be6894b4a5993e969472afe1396", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9aa48be6894b4a5993e969472afe1396"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9aa48be6894b4a5993e969472afe1396"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9aa48be6894b4a5993e969472afe1396"}]}] Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestVolumeBackupRestore-307099772 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9aa48be6894b4a5993e969472afe1396 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestVolumeBackupRestore-307099772 Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestVolumeBackupRestore-307099772-project Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 10227f104b254a91b4f14e9818244d7d Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestVolumeBackupRestore-307099772-project Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1833878766", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "37a571d0-8dac-4cf2-b1bc-1c9fd045c744", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1582104068", "security_groups": [{"name": "tempest-secgroup-smoke-2056140851"}], "networks": [{"uuid": "1cb2267c-fc9d-44d7-becd-01e5adf06201"}]}} Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBackupRestore-server-1833878766', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'volume_id': '37a571d0-8dac-4cf2-b1bc-1c9fd045c744', 'delete_on_termination': False}], 'key_name': 'tempest-TestVolumeBackupRestore-1582104068', 'security_groups': [{'name': 'tempest-secgroup-smoke-2056140851'}], 'networks': [{'uuid': '1cb2267c-fc9d-44d7-becd-01e5adf06201'}]}}} Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:05:59.810028 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aa367b7d-2e10-4af5-aea9-81551fdee262) Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:59.816809 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:05:59.823498 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:05:59.826530 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e86c0401-8567-4d75-a5eb-6c2d99fc4a92 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.807729 Nov 02 13:05:59.827760 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1023/2031] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:05:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 1811 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 13:06:00.367503 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-d572e032-e2b0-4df2-9508-e44c70d61032 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] Calling method '.version_select at 0x7eff57a971f0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:00.566539 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-d572e032-e2b0-4df2-9508-e44c70d61032 tempest-TestVolumeBackupRestore-307099772 tempest-TestVolumeBackupRestore-307099772-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1582104068" status: 202 len: 0 microversion: 2.1 time: 0.204580 Nov 02 13:06:00.580761 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1009/2032] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 13:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1582104068 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 13:06:23.712526 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:23.727534 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1344343126", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "4998e32f-6ce9-483f-8b38-b6548297360e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1033182023", "security_groups": [{"name": "tempest-secgroup-smoke-1723642014"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:24.403186 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] validate_networks() for [('4998e32f-6ce9-483f-8b38-b6548297360e', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:06:25.140340 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be) Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Request method failure captured: Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 345 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmrTgngn3GHwUrun1RoX8ZljiDp06yIPqJ0QFkQdoI0VeehgdNQMj3qvRhBoa0RBYiwqcVNkTLtw-8Zxg-f83U9nrKjqMTV1SnnGnMrssL9BTHYtHqMsjwApWe-sb8VuyB14SQe8CElw_2ePBPg3nyyCe5Hpj7JcjKZrQAqYl7Qkdrc Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_61491c06413d4385afd9e7f35b7026df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/61491c06413d4385afd9e7f35b7026df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/61491c06413d4385afd9e7f35b7026df"}]}] Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 61491c06413d4385afd9e7f35b7026df Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1129277104 Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 62451d7dd91d4a719549e29e3b7e1aab Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1129277104-project Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1344343126", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "4998e32f-6ce9-483f-8b38-b6548297360e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1033182023", "security_groups": [{"name": "tempest-secgroup-smoke-1723642014"}]}} Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:25.147995 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1344343126', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '4998e32f-6ce9-483f-8b38-b6548297360e'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1033182023', 'security_groups': [{'name': 'tempest-secgroup-smoke-1723642014'}]}}} Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:06:25.153914 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e9f215fd-e546-4131-a1b5-d0c03a1dc2be) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-1077cd26-1579-467a-b4e4-5efb520a56c9 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.435181 Nov 02 13:06:25.160626 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1024/2033] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:06:23 2022] POST /compute/v2.1/servers => generated 214 bytes in 1437 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:06:27.133427 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Nov 02 13:06:27.135486 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:27.136275 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:27.143006 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1575213077", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "157c3d64-b122-423b-96d5-a8b997499a58", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:06:27.547772 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] validate_networks() for [('b0d06de6-8a85-43bf-b702-e79f29361025', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a49d77b4-ef41-42e5-ba13-9026168257b1) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:06:28.834243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a49d77b4-ef41-42e5-ba13-9026168257b1) Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Request method failure captured: Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 355 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmrcCYydjoQKiKIu-QMS0rGwZ8yJWsm-m4G7ihDfAXVNHWflCFf65QnX90Ex7YLf_Kw_e5zVI9QWCBsiYC42yqPOo5Qj7vDi8ujjCIF46TNK2fjanlQyUMlteDpkz0EsHAWAoaPuXB3bBRn21OGvCAOBOLqzqU1LYJbTJj0-tv8RGKY Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a42e2f895074311ba70e12d1b5eaeba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}] Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 948c29a5d95c4ae1b44b3760eec4b344 Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1575213077", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "157c3d64-b122-423b-96d5-a8b997499a58", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:28.838262 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1575213077', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'snapshot', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'snapshot_id': '157c3d64-b122-423b-96d5-a8b997499a58'}], 'networks': [{'uuid': 'b0d06de6-8a85-43bf-b702-e79f29361025'}]}}} Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:06:28.845531 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a49d77b4-ef41-42e5-ba13-9026168257b1) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-682b9ba6-7a1c-49f9-91ec-ea622d89ee31 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 1.707453 Nov 02 13:06:28.855630 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1010/2034] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:06:27 2022] POST /compute/v2.1/servers => generated 214 bytes in 1710 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:06:39.794712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2fa9d6b4-086f-4532-a923-d5613cd6f822 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] Calling method '.version_select at 0x7eff5c2144c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:06:39.837510 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:06:40.011428 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2fa9d6b4-086f-4532-a923-d5613cd6f822 tempest-TestNetworkAdvancedServerOps-1129277104 tempest-TestNetworkAdvancedServerOps-1129277104-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1033182023" status: 202 len: 0 microversion: 2.1 time: 0.232069 Nov 02 13:06:40.084343 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1025/2035] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:06:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1033182023 => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:07:21.962595 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:07:21.972125 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-99286988", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c19fa563-1577-432b-9804-bc9003e3a9d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:22.058767 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] validate_networks() for [('b0d06de6-8a85-43bf-b702-e79f29361025', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-142e9fde-4ca1-4db5-b3e8-e15de9621353) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:07:22.348053 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-142e9fde-4ca1-4db5-b3e8-e15de9621353) Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Request method failure captured: Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 365 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmrcCYydjoQKiKIu-QMS0rGwZ8yJWsm-m4G7ihDfAXVNHWflCFf65QnX90Ex7YLf_Kw_e5zVI9QWCBsiYC42yqPOo5Qj7vDi8ujjCIF46TNK2fjanlQyUMlteDpkz0EsHAWAoaPuXB3bBRn21OGvCAOBOLqzqU1LYJbTJj0-tv8RGKY Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a42e2f895074311ba70e12d1b5eaeba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}] Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 948c29a5d95c4ae1b44b3760eec4b344 Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-99286988", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c19fa563-1577-432b-9804-bc9003e3a9d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:07:22.354132 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-volume-backed-server-99286988', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': 'c19fa563-1577-432b-9804-bc9003e3a9d2'}], 'networks': [{'uuid': 'b0d06de6-8a85-43bf-b702-e79f29361025'}]}}} Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:07:22.359736 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-142e9fde-4ca1-4db5-b3e8-e15de9621353) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e586145a-4abf-4f14-8c80-5582e719d5a5 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.385534 Nov 02 13:07:22.364913 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1011/2036] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:07:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 391 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:07:26.113339 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-edb31adc-e996-434c-b9bc-f726617cb2de tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: .version_select at 0x7eff5c726670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1758986410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI527DgcQzXtO5DrJfg+cVwBs8B7RFls0ARJ4kS+xwoOZUfxF/R5BUYWZ9JwabzEedSEeL8iKHsGc/ZnhN700yGykOmzAPNPIoyhYjO41pev6hxz9icI93oHG39ujZfsA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:07:26.145093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-edb31adc-e996-434c-b9bc-f726617cb2de tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Getting quotas for project 0a42e2f895074311ba70e12d1b5eaeba. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:07:26.156312 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-edb31adc-e996-434c-b9bc-f726617cb2de tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Getting quotas for user 948c29a5d95c4ae1b44b3760eec4b344 and project 0a42e2f895074311ba70e12d1b5eaeba. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:07:26.299660 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-edb31adc-e996-434c-b9bc-f726617cb2de tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.194415 Nov 02 13:07:26.300608 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1026/2037] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:07:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:08:13.565336 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:13.571876 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1035648104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1758986410", "security_groups": [{"name": "tempest-secgroup-smoke-2031606044"}], "block_device_mapping_v2": [{"uuid": "e1b00ac9-ae31-45e5-be99-14f4687dc8d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:08:13.583604 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:08:13.583890 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 13:08:13.718697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] validate_networks() for [('b0d06de6-8a85-43bf-b702-e79f29361025', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:08:14.022116 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3) Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Request method failure captured: Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 478 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmrcCYydjoQKiKIu-QMS0rGwZ8yJWsm-m4G7ihDfAXVNHWflCFf65QnX90Ex7YLf_Kw_e5zVI9QWCBsiYC42yqPOo5Qj7vDi8ujjCIF46TNK2fjanlQyUMlteDpkz0EsHAWAoaPuXB3bBRn21OGvCAOBOLqzqU1LYJbTJj0-tv8RGKY Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0a42e2f895074311ba70e12d1b5eaeba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0a42e2f895074311ba70e12d1b5eaeba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0a42e2f895074311ba70e12d1b5eaeba"}]}] Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 0a42e2f895074311ba70e12d1b5eaeba Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestVolumeBootPattern-1048336313 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 948c29a5d95c4ae1b44b3760eec4b344 Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestVolumeBootPattern-1048336313-project Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1035648104", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1758986410", "security_groups": [{"name": "tempest-secgroup-smoke-2031606044"}], "block_device_mapping_v2": [{"uuid": "e1b00ac9-ae31-45e5-be99-14f4687dc8d2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0d06de6-8a85-43bf-b702-e79f29361025"}]}} Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:08:14.026525 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1035648104', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-1758986410', 'security_groups': [{'name': 'tempest-secgroup-smoke-2031606044'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'e1b00ac9-ae31-45e5-be99-14f4687dc8d2'}], 'networks': [{'uuid': 'b0d06de6-8a85-43bf-b702-e79f29361025'}]}}} Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:08:14.031515 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4ca4fdaf-0b78-4667-8f55-3a6dec2f5de3) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b9995235-531a-4152-abe3-ad7ce7f1be27 tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.462681 Nov 02 13:08:14.037014 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1012/2038] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:08:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 464 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:08:18.040189 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:18.041126 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:08:18.042307 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:08:18.042450 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:08:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1758986410 (ip 10.222.0.64) !!! Nov 02 13:08:18.047003 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d04d0032-0900-42dd-9fc7-6c8986cf198b tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] Calling method '.version_select at 0x7eff608b5040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:08:18.176138 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d04d0032-0900-42dd-9fc7-6c8986cf198b tempest-TestVolumeBootPattern-1048336313 tempest-TestVolumeBootPattern-1048336313-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1758986410" status: 202 len: 0 microversion: 2.1 time: 0.136535 Nov 02 13:08:18.177066 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1027/2039] 10.222.0.64 () {58 vars in 1263 bytes} [Wed Nov 2 13:08:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1758986410 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:11:56.553075 n-d-857339-6 devstack@n-api.service[127767]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b4c828aa-74cf-4cac-b1f4-ebfb58212397] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 13:11:56.553666 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:11:56.554945 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:11:56.555115 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 13:11:56.557606 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:11:56.560974 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 13:11:56.560974 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:11:56.561277 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:11:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Nov 02 13:11:56.716330 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-846246902", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:11:56.887302 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] validate_networks() for None {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:11:57.139249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Flavor limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 13:11:57.139660 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Image limits 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 13:11:57.140191 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Flavor pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 13:11:57.140559 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Image pref 0:0:0 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 13:11:57.140969 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.virt.hardware [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 13:11:57.150617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:57.151104 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:57.151544 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:57.152288 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:57.152768 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:57.153201 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:57.173587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Getting quotas for project 12989eef0a7c41a99a77eab4f44a1fec. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:11:57.180937 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Getting quotas for user ca39062f3b3145dca705e96334272975 and project 12989eef0a7c41a99a77eab4f44a1fec. Resources: {'ram', 'cores', 'instances'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:11:57.194571 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Going to run 1 instances... {{(pid=127767) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 13:11:57.197342 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f990171d-1f62-41c4-b6db-f21083f74067',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 13:11:57.421804 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-de5c0800-522b-45ec-9d56-5081cab3946e tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869425 Nov 02 13:11:57.422852 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1013/2040] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:11:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 13:11:57.437692 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:11:57.439999 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 (ip 10.222.0.64) !!! Nov 02 13:11:57.440196 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:11:57.440196 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 (ip 10.222.0.64) !!! Nov 02 13:11:57.442488 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 02 13:11:57.442687 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 (ip 10.222.0.64) !!! Nov 02 13:11:57.449651 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-55550f64-8d9c-4e8f-80e6-7b81c0ca8eb0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:57.450368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-55550f64-8d9c-4e8f-80e6-7b81c0ca8eb0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:57.689941 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-55550f64-8d9c-4e8f-80e6-7b81c0ca8eb0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:57.699841 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-55550f64-8d9c-4e8f-80e6-7b81c0ca8eb0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1221 microversion: 2.1 time: 0.264222 Nov 02 13:11:57.700580 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1028/2041] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:57 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1221 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:58.724299 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ca6314d4-b0a3-4050-bb56-043f94ca9883 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:58.725002 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ca6314d4-b0a3-4050-bb56-043f94ca9883 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:58.736338 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] [b4c828aa-74cf-4cac-b1f4-ebfb58212397] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 48130. Nov 02 13:11:58.793468 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-ca6314d4-b0a3-4050-bb56-043f94ca9883 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:58.801830 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ca6314d4-b0a3-4050-bb56-043f94ca9883 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1221 microversion: 2.1 time: 0.082537 Nov 02 13:11:58.802445 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1014/2042] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:58 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1221 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:11:59.828817 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:11:59.829657 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:11:59.836873 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:59.845063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:59.845063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:59.845063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:11:59.845063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:11:59.845063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:11:59.908114 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:11:59.918150 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-5a310408-428c-4021-bdc4-742d5f68d43b tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1273 microversion: 2.1 time: 0.094260 Nov 02 13:11:59.918891 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1029/2043] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:11:59 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:00.943647 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:00.944249 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:00.952072 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:00.952911 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:00.953471 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:00.954241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:00.954846 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:00.955361 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:01.075659 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:01.086359 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-846cdb8f-2c82-45a5-b6d8-78a40abf845f tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1279 microversion: 2.1 time: 0.146761 Nov 02 13:12:01.087069 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1015/2044] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:00 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1279 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:02.111347 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:02.112177 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:02.119118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.119616 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.120062 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.120785 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.121235 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.121655 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.330352 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:02.338577 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-ad168ab7-d791-4fad-8571-1e748295bc1d tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.231852 Nov 02 13:12:02.339190 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1030/2045] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:02 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:02.887718 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6f54ad-04e4-4a24-ae52-e9bc3fe704e7", "tag": "014004e8-deaa-47a6-b25d-a2fae3fe0337"}]} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:02.898161 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:02.898967 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:02.899517 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:02.912544 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.compute.server_external_events [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] Creating event network-changed:014004e8-deaa-47a6-b25d-a2fae3fe0337 for instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 on n-h1-857339-6 Nov 02 13:12:02.919327 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [req-858fde30-8cfd-482a-a067-3b65764d0880 req-aba8ec2e-13ca-4e77-bffc-ea00822c34e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119094 Nov 02 13:12:02.920725 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1016/2046] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:03.363468 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:03.367801 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:03.370902 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.371396 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.371833 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.373367 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:03.373826 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:03.374257 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:03.600887 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:03.611394 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c94810f6-d86b-4dfa-b831-bdd8ea0432b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.251813 Nov 02 13:12:03.612102 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1031/2047] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:03 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:04.637046 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:04.638070 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:04.645697 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:04.646181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:04.646610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:04.647318 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:04.647762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:04.648179 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:04.857271 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:04.866897 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-612d716a-e68c-43f5-a5a2-7d0a664e7175 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.234862 Nov 02 13:12:04.867624 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1017/2048] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:04 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:05.891844 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:05.892845 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:05.899239 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:05.908354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.908354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:05.908354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:05.908354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:05.908354 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:06.058619 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:06.066718 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-fc9e2305-18fe-415b-a901-532b92124223 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.179417 Nov 02 13:12:06.067318 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1032/2049] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:05 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:07.090537 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:07.091952 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:07.098256 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.098744 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.099180 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.099881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:07.100882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:07.100882 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:07.163286 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:07.247306 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:07.256542 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-14f01217-e477-47f6-ac6e-a572a7d77609 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.169875 Nov 02 13:12:07.257160 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1018/2050] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:07 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 13:12:08.279669 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:08.280342 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:08.282516 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:08.287725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.288820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.288820 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:08.302065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:08.302065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:08.302065 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:08.471409 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:08.482747 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b409bc5e-6262-44b0-8c33-2f0737127fc1 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.207055 Nov 02 13:12:08.483572 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1033/2051] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:08 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:09.514338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:09.515230 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:09.517902 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=8 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:09.523417 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:09.523905 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:09.524338 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.525085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:09.525534 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:09.525956 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:09.677975 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:09.687972 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8d31540c-043d-4a76-a984-0bd591e193ee tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.179855 Nov 02 13:12:09.688844 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1019/2052] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:09 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:10.030113 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6f54ad-04e4-4a24-ae52-e9bc3fe704e7", "name": "network-vif-plugged", "status": "completed", "tag": "014004e8-deaa-47a6-b25d-a2fae3fe0337"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:10.043748 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.044226 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.044727 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.057963 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] Creating event network-vif-plugged:014004e8-deaa-47a6-b25d-a2fae3fe0337 for instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 on n-h1-857339-6 Nov 02 13:12:10.065040 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-1e379b36-7d22-40aa-811c-dc2d43a3251b req-15d1662f-a59a-4d16-8eac-ecb282ecaa44 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114056 Nov 02 13:12:10.065644 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1034/2053] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:10.712160 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:10.712910 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:10.720075 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.720598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.721043 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.721753 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:10.722206 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:10.722628 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:10.867005 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:10.875068 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-20b26163-2e0d-4752-8262-b1a99df293b0 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1321 microversion: 2.1 time: 0.166879 Nov 02 13:12:10.875655 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1020/2054] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:10 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:11.898654 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:11.899368 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:11.906152 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:11.906824 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:11.907263 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:11.908098 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:11.908439 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:11.908884 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.065788 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:12.074134 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7f0ee4e2-9d4f-47a2-8f5d-848d1ef13296 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1471 microversion: 2.1 time: 0.179874 Nov 02 13:12:12.074721 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1035/2055] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:11 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:12.150037 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-dea5a561-1b58-4cf1-8db2-663221f4b02b tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '.version_select at 0x7eff5c8ab4c0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:12.223382 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-dea5a561-1b58-4cf1-8db2-663221f4b02b tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/7ac63ec066c546f3bceda8877968fc0f" status: 200 len: 371 microversion: 2.1 time: 0.128403 Nov 02 13:12:12.223997 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1021/2056] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 13:12:12 2022] GET /compute/v2.1/os-quota-sets/7ac63ec066c546f3bceda8877968fc0f => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:12.237116 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-6b207503-9396-41d2-967b-e8733b41934d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-714005276", "id": 1285248635, "os-flavor-access:is_public": "True"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:12.335096 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-6b207503-9396-41d2-967b-e8733b41934d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.101355 Nov 02 13:12:12.338305 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1036/2057] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:12 2022] POST /compute/v2.1/flavors => generated 437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:12.349085 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1285248635"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:12.351372 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:12.359550 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.360045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.360521 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.361241 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.361699 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.362127 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c995036-20b6-4176-9e0f-6a1137b13633) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:12.461318 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c995036-20b6-4176-9e0f-6a1137b13633) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Request method failure captured: Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action HTTP/1.1 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 39 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmyc4Ev7aOqTDxqr9P-HG6ZKGKiZJH2EWwVZmnBGpwb4QngeO7Sd6TG2BtQld_EOhx4jcDriSMNqsDydR8H3uUOTB3aqFT01-jfjSPRVvxIdizBwnLYKw4-pbKIQlmHdPIATOsJM6dVlIIooi3zotxyCqPAf6iQfhkEwVvtz7_za9ZY Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 7ac63ec066c546f3bceda8877968fc0f Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,admin,member Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,admin,member Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7ac63ec066c546f3bceda8877968fc0f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7ac63ec066c546f3bceda8877968fc0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7ac63ec066c546f3bceda8877968fc0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7ac63ec066c546f3bceda8877968fc0f"}]}] Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 7ac63ec066c546f3bceda8877968fc0f Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersAdminNegativeTestJSON-2122231180-project-admin Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 26bcf53003144899ba6477704f2b9b8e Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2122231180-project-admin Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: {"resize": {"flavorRef": "1285248635"}} Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'id': 'da6f54ad-04e4-4a24-ae52-e9bc3fe704e7', 'body': {'resize': {'flavorRef': '1285248635'}}} Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:12:12.465781 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:12.471258 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-8c995036-20b6-4176-9e0f-6a1137b13633) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-159e9673-3934-4c94-a9e7-271ff51b7b6d tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action" status: 500 len: 214 microversion: 2.1 time: 0.120569 Nov 02 13:12:12.475545 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1022/2058] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:12 2022] POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action => generated 214 bytes in 122 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:12.504364 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-98511f80-cc92-4d80-9726-005973d864bb tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:12.584035 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-98511f80-cc92-4d80-9726-005973d864bb tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/1285248635" status: 202 len: 0 microversion: 2.1 time: 0.083335 Nov 02 13:12:12.584697 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1037/2059] 10.222.0.64 () {58 vars in 1161 bytes} [Wed Nov 2 13:12:12 2022] DELETE /compute/v2.1/flavors/1285248635 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:12.593800 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6dee6444-88af-4715-a576-2ba77008e342 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:12.614839 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6dee6444-88af-4715-a576-2ba77008e342 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025287 Nov 02 13:12:12.615442 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1023/2060] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 13:12:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:12.644063 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-eb7ee4da-0767-481a-886e-de42fd55d839 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '.version_select at 0x7eff608b5dc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:12.723986 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-eb7ee4da-0767-481a-886e-de42fd55d839 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "GET /compute/v2.1/os-quota-sets/7ac63ec066c546f3bceda8877968fc0f" status: 200 len: 371 microversion: 2.1 time: 0.085485 Nov 02 13:12:12.724603 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1038/2061] 10.222.0.64 () {58 vars in 1242 bytes} [Wed Nov 2 13:12:12 2022] GET /compute/v2.1/os-quota-sets/7ac63ec066c546f3bceda8877968fc0f => generated 371 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:12.737045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1fb0b257-d685-47e6-9731-e6a40d9a704e tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2143993383", "id": 853709916, "os-flavor-access:is_public": "True"}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:12.821679 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1fb0b257-d685-47e6-9731-e6a40d9a704e tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.088350 Nov 02 13:12:12.822336 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1024/2062] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:12 2022] POST /compute/v2.1/flavors => generated 434 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:12:12.836310 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "853709916"}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:12.838936 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:12.846216 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.846766 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.847173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.847919 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:12.848384 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:12.848840 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02629be9-3329-4356-a190-32776621c01a) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:12.954673 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02629be9-3329-4356-a190-32776621c01a) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Request method failure captured: Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action HTTP/1.1 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 38 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmyc4Ev7aOqTDxqr9P-HG6ZKGKiZJH2EWwVZmnBGpwb4QngeO7Sd6TG2BtQld_EOhx4jcDriSMNqsDydR8H3uUOTB3aqFT01-jfjSPRVvxIdizBwnLYKw4-pbKIQlmHdPIATOsJM6dVlIIooi3zotxyCqPAf6iQfhkEwVvtz7_za9ZY Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 7ac63ec066c546f3bceda8877968fc0f Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,admin,member Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,admin,member Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7ac63ec066c546f3bceda8877968fc0f", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7ac63ec066c546f3bceda8877968fc0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7ac63ec066c546f3bceda8877968fc0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7ac63ec066c546f3bceda8877968fc0f"}]}] Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 7ac63ec066c546f3bceda8877968fc0f Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2122231180 Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersAdminNegativeTestJSON-2122231180-project-admin Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 26bcf53003144899ba6477704f2b9b8e Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2122231180-project-admin Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: {"resize": {"flavorRef": "853709916"}} Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'da6f54ad-04e4-4a24-ae52-e9bc3fe704e7', 'body': {'resize': {'flavorRef': '853709916'}}} Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Nov 02 13:12:12.959617 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 381, in inner Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if self.network_api.instance_has_extended_resource_request( Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1034, in instance_has_extended_resource_request Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi if not self.has_extended_resource_request_extension(admin_context): Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:12.964866 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-02629be9-3329-4356-a190-32776621c01a) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-2fdd1f6a-59b5-4350-b2f6-34d38e17117f tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action" status: 500 len: 214 microversion: 2.1 time: 0.128874 Nov 02 13:12:12.969424 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1039/2063] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Nov 2 13:12:12 2022] POST /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7/action => generated 214 bytes in 131 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:12.978068 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-e6473118-f853-4861-ae5e-d8b7bd32345b tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.087400 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-e6473118-f853-4861-ae5e-d8b7bd32345b tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "DELETE /compute/v2.1/flavors/853709916" status: 202 len: 0 microversion: 2.1 time: 0.114177 Nov 02 13:12:13.088041 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1025/2064] 10.222.0.64 () {58 vars in 1158 bytes} [Wed Nov 2 13:12:12 2022] DELETE /compute/v2.1/flavors/853709916 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:12:13.096923 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-66353e3a-babd-4981-9edd-16b9709a99a7 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.120918 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-66353e3a-babd-4981-9edd-16b9709a99a7 tempest-ServersAdminNegativeTestJSON-2122231180 tempest-ServersAdminNegativeTestJSON-2122231180-project-admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027619 Nov 02 13:12:13.121517 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1040/2065] 10.222.0.64 () {58 vars in 1146 bytes} [Wed Nov 2 13:12:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:13.145747 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.146270 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:13.153409 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.154682 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.154887 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.155601 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.156110 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.156617 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.190744 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Going to try to terminate instance {{(pid=127767) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 13:12:13.562612 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ac96fc8b-6252-44f0-aab2-8c9218325ff9 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "DELETE /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 204 len: 0 microversion: 2.1 time: 0.420353 Nov 02 13:12:13.563312 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1026/2066] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Nov 2 13:12:13 2022] DELETE /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 13:12:13.572447 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:13.573221 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:13.580712 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.581124 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.582073 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.582380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:13.582836 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:13.583295 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:13.731211 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.policy [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127766) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:13.740017 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-10ac979a-64e4-48e8-9d38-f09b3b906b70 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1477 microversion: 2.1 time: 0.171849 Nov 02 13:12:13.740641 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1041/2067] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:13 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:14.765583 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:14.766523 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:14.773841 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.774250 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.774694 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.775439 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:14.775901 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:14.776328 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:14.947986 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:14.961605 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-6fcc7cc4-da4b-417a-8855-a80d6fa16bf3 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1477 microversion: 2.1 time: 0.201201 Nov 02 13:12:14.962359 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1027/2068] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:14 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:15.715438 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6f54ad-04e4-4a24-ae52-e9bc3fe704e7", "name": "network-vif-deleted", "tag": "014004e8-deaa-47a6-b25d-a2fae3fe0337"}]} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:15.729665 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.730376 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.730760 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.743848 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.compute.server_external_events [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] Creating event network-vif-deleted:014004e8-deaa-47a6-b25d-a2fae3fe0337 for instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 on n-h1-857339-6 Nov 02 13:12:15.749931 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [req-4ef274f7-329c-404d-8118-1f993fda7867 req-76d536b4-ec06-4c7f-8dd2-34b1464e4978 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037956 Nov 02 13:12:15.750763 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1042/2069] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Nov 2 13:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:15.992001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:15.992001 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.compute.api [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127767) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:15.995553 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.996054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.996511 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:15.997759 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:15.998224 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:15.998648 n-d-857339-6 devstack@n-api.service[127767]: DEBUG oslo_concurrency.lockutils [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:16.089363 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.policy [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca39062f3b3145dca705e96334272975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12989eef0a7c41a99a77eab4f44a1fec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127767) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 13:12:16.098803 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-87a109dc-28b2-4322-9fa4-e3d67166c935 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 200 len: 1306 microversion: 2.1 time: 0.115429 Nov 02 13:12:16.099410 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1028/2070] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:15 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 13:12:17.139093 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Calling method '>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:17.139815 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.compute.api [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] [instance: da6f54ad-04e4-4a24-ae52-e9bc3fe704e7] Fetching instance by UUID {{(pid=127766) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 13:12:17.146548 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:17.147034 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:17.147500 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:17.148207 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Acquiring lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 13:12:17.148694 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 13:12:17.149129 n-d-857339-6 devstack@n-api.service[127766]: DEBUG oslo_concurrency.lockutils [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Lock "f00f0d66-5cbd-45f5-9ce5-838ebd846832" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 13:12:17.163671 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] HTTP exception thrown: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Request method failure captured: Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: request: GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 HTTP/1.1 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 0 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmybMABAeaj5FmR9XTAI8cgTxewJKRoQNj-c3VzUAtmFmWUpABBe09LKWsOo7vTuyAS9Vo9ghsKFhw-Wt2lZu32lg6s-wM5XufOvdFJ4GahBrTjR8OZqyWIolaQWfjMND1IRB110m9QnvA2FlqRefvQbAAdRKvn9MyWfDWPDAtiefTA Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 12989eef0a7c41a99a77eab4f44a1fec Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768510930 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_12989eef0a7c41a99a77eab4f44a1fec", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/12989eef0a7c41a99a77eab4f44a1fec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/12989eef0a7c41a99a77eab4f44a1fec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/12989eef0a7c41a99a77eab4f44a1fec"}]}] Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768510930 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 12989eef0a7c41a99a77eab4f44a1fec Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768510930 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServersAdminNegativeTestJSON-768510930-project Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: ca39062f3b3145dca705e96334272975 Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768510930-project Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: exception: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'id': 'da6f54ad-04e4-4a24-ae52-e9bc3fe704e7'} Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:17.165380 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] Returning 404 to user: Instance da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 could not be found. {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-c7678b77-75d2-4ab2-a402-0bc74e5ee452 tempest-ServersAdminNegativeTestJSON-768510930 tempest-ServersAdminNegativeTestJSON-768510930-project] 10.222.0.64 "GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7" status: 404 len: 111 microversion: 2.1 time: 0.032795 Nov 02 13:12:17.170780 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1043/2071] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Nov 2 13:12:17 2022] GET /compute/v2.1/servers/da6f54ad-04e4-4a24-ae52-e9bc3fe704e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 13:12:28.618847 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:28.619717 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:28.620362 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:28.757855 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-33060885", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "73f5cf02-810d-4212-93cb-2ed926b6bac4"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:28.833520 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] validate_networks() for [('73f5cf02-810d-4212-93cb-2ed926b6bac4', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:29.145567 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3) Nov 02 13:12:29.150390 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.152129 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:29.152129 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] Request method failure captured: Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 205 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmy85NAG8b0C6ZB98pmQaDGcGhb8Tx9OdyJruVJUPFVYBELglBtsZWfNRtLWgAMYp5c8mAKIPq9FUHQYfJyMYnZquA0pdsKr3gicwqonxMoYuXIp_0JenZglHZNO6cdDO10e9tLzqrLD3bszYHEa5H1IORe1P40bMpagZrgzBXobDvc Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 09d23c3964304a16bcd7080a9313a5fc Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-DeleteServersTestJSON-1513732849 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_09d23c3964304a16bcd7080a9313a5fc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/09d23c3964304a16bcd7080a9313a5fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/09d23c3964304a16bcd7080a9313a5fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/09d23c3964304a16bcd7080a9313a5fc"}]}] Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-DeleteServersTestJSON-1513732849 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 09d23c3964304a16bcd7080a9313a5fc Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1513732849 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-DeleteServersTestJSON-1513732849-project Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: dbf340c36cd444a4894bff210de05764 Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-DeleteServersTestJSON-1513732849-project Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-DeleteServersTestJSON-server-33060885", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "73f5cf02-810d-4212-93cb-2ed926b6bac4"}]}} Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-DeleteServersTestJSON-server-33060885', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '73f5cf02-810d-4212-93cb-2ed926b6bac4'}]}}} Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:29.155293 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-aab24f15-2f1e-4eca-83f4-49f20b3e40d3) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:29.161171 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-3cde62d8-09ff-4e1b-85f3-59479dcfad2a tempest-DeleteServersTestJSON-1513732849 tempest-DeleteServersTestJSON-1513732849-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.543587 Nov 02 13:12:29.165801 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1029/2072] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 545 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:42.255921 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:42.256856 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:42.257382 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell1:SELECT=52 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:42.394029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-648064423", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "d5418b5c-3e26-4f8a-bb42-2068b64da199"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:42.459297 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] validate_networks() for [('d5418b5c-3e26-4f8a-bb42-2068b64da199', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f64a514-2b74-46a2-8132-69c4affc79f8) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:42.693898 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f64a514-2b74-46a2-8132-69c4affc79f8) Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:42.699591 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Request method failure captured: Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 209 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYmzKpJfdgO6N-DLaVLhI5u0n-2BlgK869ss2WGTThvO0BF-MzTppBqrBTW6qvzrqoLeRAFOnRGkn2twewdalZGH6zbrd0WR7aEmIiI6v0Pv7jWR8B4bufpAu5SxLac5v3K-obA5zAH7CmdAu6fGj0HLKE0EVugkUtC8peJAkAGXPzok Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 6e7a1c1ebdbd4c6a917564a830970660 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e7a1c1ebdbd4c6a917564a830970660", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e7a1c1ebdbd4c6a917564a830970660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e7a1c1ebdbd4c6a917564a830970660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e7a1c1ebdbd4c6a917564a830970660"}]}] Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 6e7a1c1ebdbd4c6a917564a830970660 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-ServerDiskConfigTestJSON-277437254-project Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 20c1d413bce041529061f61dd90fb073 Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-ServerDiskConfigTestJSON-277437254-project Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-648064423", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "d5418b5c-3e26-4f8a-bb42-2068b64da199"}]}} Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-648064423', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'd5418b5c-3e26-4f8a-bb42-2068b64da199'}]}}} Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:42.705307 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9f64a514-2b74-46a2-8132-69c4affc79f8) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:42.711139 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-d46cfd0d-9935-4685-a108-6ea7b6d53872 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.458883 Nov 02 13:12:42.720096 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1044/2073] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 462 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:42.767908 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-437151499", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "d5418b5c-3e26-4f8a-bb42-2068b64da199"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:42.826065 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] validate_networks() for [('d5418b5c-3e26-4f8a-bb42-2068b64da199', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a8390c3f-42c5-46ca-9714-017770812419) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:43.065514 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a8390c3f-42c5-46ca-9714-017770812419) Nov 02 13:12:43.069259 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.071709 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:43.071709 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Request method failure captured: Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 209 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmzKpJfdgO6N-DLaVLhI5u0n-2BlgK869ss2WGTThvO0BF-MzTppBqrBTW6qvzrqoLeRAFOnRGkn2twewdalZGH6zbrd0WR7aEmIiI6v0Pv7jWR8B4bufpAu5SxLac5v3K-obA5zAH7CmdAu6fGj0HLKE0EVugkUtC8peJAkAGXPzok Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 6e7a1c1ebdbd4c6a917564a830970660 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e7a1c1ebdbd4c6a917564a830970660", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e7a1c1ebdbd4c6a917564a830970660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e7a1c1ebdbd4c6a917564a830970660"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e7a1c1ebdbd4c6a917564a830970660"}]}] Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 6e7a1c1ebdbd4c6a917564a830970660 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-277437254 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerDiskConfigTestJSON-277437254-project Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 20c1d413bce041529061f61dd90fb073 Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerDiskConfigTestJSON-277437254-project Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-437151499", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "d5418b5c-3e26-4f8a-bb42-2068b64da199"}]}} Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerDiskConfigTestJSON-server-437151499', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'd5418b5c-3e26-4f8a-bb42-2068b64da199'}]}}} Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:43.074031 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a8390c3f-42c5-46ca-9714-017770812419) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:43.081934 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-f852e7e8-b88f-4cc5-8c38-57b68f1a17f0 tempest-ServerDiskConfigTestJSON-277437254 tempest-ServerDiskConfigTestJSON-277437254-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.313539 Nov 02 13:12:43.092091 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1030/2074] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:42 2022] POST /compute/v2.1/servers => generated 214 bytes in 316 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:55.954327 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:56.089175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73c3493c-6fd0-498e-bdde-e27fd58fa335 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Action: 'create', calling method: .version_select at 0x7eff5c269af0>, body: {"keypair": {"name": "tempest-keypair-1520099476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFOGOxE21ifWPQbxo8uui3o9b1XSKJGjwLe7/Oux0UHr2QLFrLb31qCyVZlqT9TwP6mg26jDTHI585Wd5Mj2IHSs8DuWCfjAKN5+SvHfWMaR8NOYkwSmLpHnc6B9FnD0g=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:56.108251 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-73c3493c-6fd0-498e-bdde-e27fd58fa335 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Getting quotas for project a31ce9d15a694d549202903d3761e616. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:12:56.114569 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-73c3493c-6fd0-498e-bdde-e27fd58fa335 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Getting quotas for user 61ab14de1670457cb831f8baa233bb18 and project a31ce9d15a694d549202903d3761e616. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:12:56.250681 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-73c3493c-6fd0-498e-bdde-e27fd58fa335 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296665 Nov 02 13:12:56.251982 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1045/2075] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:12:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:12:59.011154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:12:59.011154 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1923278603", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69fc884e-4624-4391-adf2-b05689683438"}], "security_groups": [{"name": "tempest-securitygroup--1441611233"}], "key_name": "tempest-keypair-1520099476", "user_data": "}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:12:59.132066 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] validate_networks() for [('69fc884e-4624-4391-adf2-b05689683438', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a97025e3-dcd5-4286-973a-b164ae7af457) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:59.385577 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a97025e3-dcd5-4286-973a-b164ae7af457) Nov 02 13:12:59.390313 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.393276 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:59.393276 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Request method failure captured: Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 494 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmzXUAwkMIudcYGGbZBPq-WOaLNPrvqjy_S9O1OMSBMTxILldzwdduLqGO-bkR7XSCj42y8cnZQx6erVmpi5j_IYGB6VKvOeBL8CYvJjUSG62Px8tcJSBkCBSZG0reSk9d4Eoe2cFU-EDXcI3axLjYCMom_R3EWMuZLmcG0XLvq1dC4 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: a31ce9d15a694d549202903d3761e616 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServerActionsTestJSON-610598827 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a31ce9d15a694d549202903d3761e616", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a31ce9d15a694d549202903d3761e616"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a31ce9d15a694d549202903d3761e616"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a31ce9d15a694d549202903d3761e616"}]}] Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServerActionsTestJSON-610598827 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: a31ce9d15a694d549202903d3761e616 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServerActionsTestJSON-610598827 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServerActionsTestJSON-610598827-project Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 61ab14de1670457cb831f8baa233bb18 Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServerActionsTestJSON-610598827-project Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServerActionsTestJSON-server-1923278603", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "adminPass": "H4@!sVb2^BGWQJ4", "networks": [{"uuid": "69fc884e-4624-4391-adf2-b05689683438"}], "security_groups": [{"name": "tempest-securitygroup--1441611233"}], "key_name": "tempest-keypair-1520099476", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServerActionsTestJSON-server-1923278603', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'adminPass': 'H4@!sVb2^BGWQJ4', 'networks': [{'uuid': '69fc884e-4624-4391-adf2-b05689683438'}], 'security_groups': [{'name': 'tempest-securitygroup--1441611233'}], 'key_name': 'tempest-keypair-1520099476', 'user_data': 'IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo='}}} Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:12:59.395606 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-a97025e3-dcd5-4286-973a-b164ae7af457) Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:59.400437 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.405218 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:12:59.407794 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:12:59.407794 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:12:59.408789 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-cc9b7c35-f81c-42d0-ad0b-80b9264f3e28 tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.408132 Nov 02 13:12:59.409389 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1031/2076] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:12:58 2022] POST /compute/v2.1/servers => generated 214 bytes in 412 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:12:59.418246 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-56e30e23-4366-4bf3-99d7-0e58ebe8d93b tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] Calling method '.version_select at 0x7eff608b53a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:12:59.626015 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-56e30e23-4366-4bf3-99d7-0e58ebe8d93b tempest-ServerActionsTestJSON-610598827 tempest-ServerActionsTestJSON-610598827-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520099476" status: 202 len: 0 microversion: 2.1 time: 0.211636 Nov 02 13:12:59.626654 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1046/2077] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Nov 2 13:12:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520099476 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:13:13.478217 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:13:13.631707 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879996418", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "eaff6805-7281-4d5b-aa9a-cb3e2bc5b760"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:13:13.707654 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] validate_networks() for [('eaff6805-7281-4d5b-aa9a-cb3e2bc5b760', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-231f1a74-36dd-4f13-a77f-1e56191e0e71) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:13:13.941873 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-231f1a74-36dd-4f13-a77f-1e56191e0e71) Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] Request method failure captured: Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 209 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYmzpcccwqmcg1o8P4b8Lhjp7kAezOtNC-rcWuBeD2hJC6dBrO2eGS2YV3i3BE6e43VfJ0sVeB1GnULJ9hzMGskOn6rZ-JblvUIlIzETtWOzjcV_cFcwvoreLXvjO3FfK5dn5gwiw6jTZVnM-4C19T1kWBsJOflLN0Bd8GA8hn13Hrfg Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 3f2d877784ae4806858c9a0baec1cc0e Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-ServersNegativeTestJSON-142153809 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3f2d877784ae4806858c9a0baec1cc0e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3f2d877784ae4806858c9a0baec1cc0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3f2d877784ae4806858c9a0baec1cc0e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3f2d877784ae4806858c9a0baec1cc0e"}]}] Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-ServersNegativeTestJSON-142153809 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 3f2d877784ae4806858c9a0baec1cc0e Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-ServersNegativeTestJSON-142153809 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-ServersNegativeTestJSON-142153809-project Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 90a02f4f51e449b280ec424c9e8ccf39 Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-ServersNegativeTestJSON-142153809-project Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1879996418", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "eaff6805-7281-4d5b-aa9a-cb3e2bc5b760"}]}} Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1879996418', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'eaff6805-7281-4d5b-aa9a-cb3e2bc5b760'}]}}} Nov 02 13:13:13.946587 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:13:13.952875 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-231f1a74-36dd-4f13-a77f-1e56191e0e71) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-5223a8e3-1d73-486e-b66c-30bd204e3398 tempest-ServersNegativeTestJSON-142153809 tempest-ServersNegativeTestJSON-142153809-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.469512 Nov 02 13:13:13.959483 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1032/2078] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:13:13 2022] POST /compute/v2.1/servers => generated 214 bytes in 475 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:14:07.725118 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:07.725924 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:07.983070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0f732915-40bb-4e7a-9c67-4a4b172c54a7 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: .version_select at 0x7eff5c19da60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1212503805", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9671zR7S8KlUvp07aFEnh0vfCI4lHViLJw7kwv14KtkP75e/iTIm1U/fj9pFNIjL0jCBMOn9gL5CSPM8qKhBgK3+AuQOOv2PoomXvCR7hFj9Bvt6S6Yf7ZXz0gZtkf6g=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:08.002734 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0f732915-40bb-4e7a-9c67-4a4b172c54a7 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:08.010366 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0f732915-40bb-4e7a-9c67-4a4b172c54a7 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for user 57e194058f1c4d41b809218518b4492e and project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:08.178043 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0f732915-40bb-4e7a-9c67-4a4b172c54a7 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.454179 Nov 02 13:14:08.178693 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1047/2079] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:14:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:08.232609 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=2 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:08.238646 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1297717967", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1212503805", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:08.305020 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] validate_networks() for [('58a221da-a7bf-40be-b10c-a79f21467744', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d18f431-5232-4191-84ab-bbda1fdd172c) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:08.537555 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d18f431-5232-4191-84ab-bbda1fdd172c) Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Request method failure captured: Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 273 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm0WqPjhpWdT26vs3AwS3G-0zwF6d7TpCAvlw6Sj-3n7a8xbR092fbuJ63fbLzmfRiz1Ii-jll4RkX8t6ipWL4dPO9ihq4257_J5ADBRWOglIqU0eEPBKRWz-JokSIQgTxugU-0PFOFLNDHn_0Q904mAkYy4yH54DdP9ylqXS6QjptQ Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3e5c7cd329741efa45718744a7c9ba6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}] Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 57e194058f1c4d41b809218518b4492e Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1297717967", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1212503805", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:08.540243 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-1297717967', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1212503805', 'networks': [{'uuid': '58a221da-a7bf-40be-b10c-a79f21467744'}]}}} Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:08.544148 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-7d18f431-5232-4191-84ab-bbda1fdd172c) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-083e8ea2-5847-40b2-a658-8502641853e1 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.311449 Nov 02 13:14:08.547123 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1033/2080] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:14:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 313 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:14:08.559411 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-73578770-01c5-4e72-b202-1e467e7b5778 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Calling method '.version_select at 0x7eff5c19ddc0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:08.669441 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-73578770-01c5-4e72-b202-1e467e7b5778 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1212503805" status: 202 len: 0 microversion: 2.1 time: 0.114194 Nov 02 13:14:08.670205 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1048/2081] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 13:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1212503805 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:08.684527 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-ab53a914-9c23-490a-96c7-7e1116779267 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: .version_select at 0x7eff57a31310>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1890375072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoyZvdwnMKKngynRDRNN/SMUI2+xKH8DdzUqICO7XqpemiXGXkDqBuPwSp0VwEg75SwQk8ay+pM8apOYpNQeScRm9Gg9rh4l5DQnRk5IKdaTA1N0A3EHTd0PIDusnCLHA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:08.703662 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-ab53a914-9c23-490a-96c7-7e1116779267 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:08.710769 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-ab53a914-9c23-490a-96c7-7e1116779267 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for user 57e194058f1c4d41b809218518b4492e and project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:08.846581 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-ab53a914-9c23-490a-96c7-7e1116779267 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.166710 Nov 02 13:14:08.847542 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1034/2082] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:14:08 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:14:08.901404 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-290169732", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1890375072", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:08.975949 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] validate_networks() for [('58a221da-a7bf-40be-b10c-a79f21467744', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9666d184-70e7-4f15-be9e-fa5973b9c83d) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:09.268760 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9666d184-70e7-4f15-be9e-fa5973b9c83d) Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.272298 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Request method failure captured: Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 272 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm0WqPjhpWdT26vs3AwS3G-0zwF6d7TpCAvlw6Sj-3n7a8xbR092fbuJ63fbLzmfRiz1Ii-jll4RkX8t6ipWL4dPO9ihq4257_J5ADBRWOglIqU0eEPBKRWz-JokSIQgTxugU-0PFOFLNDHn_0Q904mAkYy4yH54DdP9ylqXS6QjptQ Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3e5c7cd329741efa45718744a7c9ba6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}] Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 57e194058f1c4d41b809218518b4492e Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-290169732", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1890375072", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-290169732', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1890375072', 'networks': [{'uuid': '58a221da-a7bf-40be-b10c-a79f21467744'}]}}} Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:09.274590 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9666d184-70e7-4f15-be9e-fa5973b9c83d) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:09.279087 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-dd23000e-30ad-419a-93fe-b3a1f97ea67f tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.380223 Nov 02 13:14:09.282929 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1049/2083] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:14:08 2022] POST /compute/v2.1/servers => generated 214 bytes in 382 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:14:09.292607 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-635aef72-4278-4399-8209-1c98da0781ec tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Calling method '.version_select at 0x7eff57a31700>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:09.376996 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-635aef72-4278-4399-8209-1c98da0781ec tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1890375072" status: 202 len: 0 microversion: 2.1 time: 0.091119 Nov 02 13:14:09.377759 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1035/2084] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 13:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1890375072 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:09.391897 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-3473ac24-c441-4994-bb70-8a7c4d1cfb08 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: .version_select at 0x7eff5c726b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1252615711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILKgS4tG819Sq1vqQuBlkpN9VKl67tNdUUXX+BUPzJ8XLETA87ipvsEPtvcKHXieRl0/wzMc2vuqrI4/GDjTOEkmMIwwqIgqwiGA+WrumqhvGPf1ox+KCiDoWJiSpPCeQ=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:09.411908 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-3473ac24-c441-4994-bb70-8a7c4d1cfb08 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:09.417883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-3473ac24-c441-4994-bb70-8a7c4d1cfb08 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Getting quotas for user 57e194058f1c4d41b809218518b4492e and project e3e5c7cd329741efa45718744a7c9ba6. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:09.519841 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-3473ac24-c441-4994-bb70-8a7c4d1cfb08 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.131382 Nov 02 13:14:09.521175 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1050/2085] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:14:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:09.597734 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-616437147", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1252615711", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:09.664359 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] validate_networks() for [('58a221da-a7bf-40be-b10c-a79f21467744', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-76b919f9-a628-48a6-95fe-308c6938ad60) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:09.980080 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-76b919f9-a628-48a6-95fe-308c6938ad60) Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Request method failure captured: Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 272 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm0WqPjhpWdT26vs3AwS3G-0zwF6d7TpCAvlw6Sj-3n7a8xbR092fbuJ63fbLzmfRiz1Ii-jll4RkX8t6ipWL4dPO9ihq4257_J5ADBRWOglIqU0eEPBKRWz-JokSIQgTxugU-0PFOFLNDHn_0Q904mAkYy4yH54DdP9ylqXS6QjptQ Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e3e5c7cd329741efa45718744a7c9ba6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e3e5c7cd329741efa45718744a7c9ba6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e3e5c7cd329741efa45718744a7c9ba6"}]}] Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: e3e5c7cd329741efa45718744a7c9ba6 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-2049079912 Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 57e194058f1c4d41b809218518b4492e Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestEncryptedCinderVolumes-2049079912-project Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-616437147", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1252615711", "networks": [{"uuid": "58a221da-a7bf-40be-b10c-a79f21467744"}]}} Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:09.987849 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestEncryptedCinderVolumes-server-616437147', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestEncryptedCinderVolumes-1252615711', 'networks': [{'uuid': '58a221da-a7bf-40be-b10c-a79f21467744'}]}}} Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:09.995381 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-76b919f9-a628-48a6-95fe-308c6938ad60) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-570e0f0e-e9af-4828-9212-f406d2684b1c tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.395221 Nov 02 13:14:10.006694 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1036/2086] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:14:09 2022] POST /compute/v2.1/servers => generated 214 bytes in 398 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:14:10.013156 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-e24a3cce-4184-40dc-a261-8401178c0c09 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] Calling method '.version_select at 0x7eff5c7f28b0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:10.086102 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-e24a3cce-4184-40dc-a261-8401178c0c09 tempest-TestEncryptedCinderVolumes-2049079912 tempest-TestEncryptedCinderVolumes-2049079912-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1252615711" status: 202 len: 0 microversion: 2.1 time: 0.091280 Nov 02 13:14:10.086645 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1051/2087] 10.222.0.64 () {58 vars in 1278 bytes} [Wed Nov 2 13:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1252615711 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:14:49.032864 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.033585 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.037613 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-44798bc6-a204-416f-9d4a-97ddfbdd4c40 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Action: 'create', calling method: .version_select at 0x7eff606fcdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-752522543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC19Lg8dMnPUYDbHCdoOK18QHnniEyhaQT4bPnMA/svEh8kmWYUsG2Vrh87RNsJaPBdgXm1RDHmQJb1iTVfq6pxmuTqTzeAC07coakPBD2rQUvPmlKe26SFqwh5a5nzE+Q=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:49.055165 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-44798bc6-a204-416f-9d4a-97ddfbdd4c40 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Getting quotas for project de4a5e32387f4e81bd7c863b544a787e. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:14:49.060548 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-44798bc6-a204-416f-9d4a-97ddfbdd4c40 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Getting quotas for user 8508520adb904d4d8f390018299f68cd and project de4a5e32387f4e81bd7c863b544a787e. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:14:49.146348 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-44798bc6-a204-416f-9d4a-97ddfbdd4c40 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.115486 Nov 02 13:14:49.146932 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1037/2088] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:14:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:14:49.194408 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=8 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.195202 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:14:49.199474 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-907357828", "imageRef": "fcd1fc3f-51a8-4f16-b784-1c247693f424", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-752522543", "networks": [{"uuid": "51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:14:49.252175 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] validate_networks() for [('51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ba67ccc-c5d2-4561-88be-0a06c4936634) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:49.481298 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ba67ccc-c5d2-4561-88be-0a06c4936634) Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:49.484896 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Request method failure captured: Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 267 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm01F4FuswcwhLXYt3N3CSFccaUefch0sRigSR4PRNuw08gp5eO1e9rfsQyJg9qvW7iNZRiwbLsN23C28uLpCkp4vVO8K9yMYmQMPy_QmMzf0tBDpBs6kQDSgT5KF9rUMcsEFw-vkMstFRxfXyMu5rOPbYuhsrvxBxZc8ML8ULSVBmc Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: de4a5e32387f4e81bd7c863b544a787e Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_de4a5e32387f4e81bd7c863b544a787e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de4a5e32387f4e81bd7c863b544a787e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/de4a5e32387f4e81bd7c863b544a787e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de4a5e32387f4e81bd7c863b544a787e"}]}] Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: de4a5e32387f4e81bd7c863b544a787e Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestMinimumBasicScenario-1530830610-project Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 8508520adb904d4d8f390018299f68cd Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestMinimumBasicScenario-1530830610-project Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-907357828", "imageRef": "fcd1fc3f-51a8-4f16-b784-1c247693f424", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-752522543", "networks": [{"uuid": "51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0"}]}} Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-907357828', 'imageRef': 'fcd1fc3f-51a8-4f16-b784-1c247693f424', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-752522543', 'networks': [{'uuid': '51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0'}]}}} Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:14:49.486935 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-2ba67ccc-c5d2-4561-88be-0a06c4936634) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:14:49.491267 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-7cdbf327-ba71-4abb-9e09-7b8480b60bf8 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.295790 Nov 02 13:14:49.494982 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1052/2089] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:14:49 2022] POST /compute/v2.1/servers => generated 214 bytes in 298 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:14:49.507442 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-137d4a1a-b3f0-464a-b537-a56865ffbcdc tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Calling method '.version_select at 0x7eff60730940>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:14:49.587713 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-137d4a1a-b3f0-464a-b537-a56865ffbcdc tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-752522543" status: 202 len: 0 microversion: 2.1 time: 0.088076 Nov 02 13:14:49.588592 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1038/2090] 10.222.0.64 () {58 vars in 1269 bytes} [Wed Nov 2 13:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-752522543 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:01.724277 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:01.728386 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-201d4d9e-aee6-4500-ae67-d784b9d19934 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Action: 'create', calling method: .version_select at 0x7eff5c19daf0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2117215898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPB15r2aerGn2RoF+5obnX3rC1Y9S7SqKq9TNY6GVOpiiIZ/N/pYDeyswrGFymX5skcbDZrNyaPQ8wrvWPEG03l5yforrAvOydx1VeCp0x+t3Y5rczUbsKhOAbVekjv09Q=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:01.745698 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-201d4d9e-aee6-4500-ae67-d784b9d19934 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Getting quotas for project de4a5e32387f4e81bd7c863b544a787e. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:01.753445 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-201d4d9e-aee6-4500-ae67-d784b9d19934 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Getting quotas for user 8508520adb904d4d8f390018299f68cd and project de4a5e32387f4e81bd7c863b544a787e. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:01.948541 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-201d4d9e-aee6-4500-ae67-d784b9d19934 tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.225024 Nov 02 13:15:01.949184 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1053/2091] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:15:01 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:01.999291 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:02.003834 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1612034992", "imageRef": "274eb36e-d8f6-41b8-b5b5-29ec4bdb66ee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2117215898", "networks": [{"uuid": "51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:02.058817 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] validate_networks() for [('51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b028842d-c0c9-4f2d-b815-573a04af4761) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:02.277707 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b028842d-c0c9-4f2d-b815-573a04af4761) Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Request method failure captured: Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 269 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm01F4FuswcwhLXYt3N3CSFccaUefch0sRigSR4PRNuw08gp5eO1e9rfsQyJg9qvW7iNZRiwbLsN23C28uLpCkp4vVO8K9yMYmQMPy_QmMzf0tBDpBs6kQDSgT5KF9rUMcsEFw-vkMstFRxfXyMu5rOPbYuhsrvxBxZc8ML8ULSVBmc Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: de4a5e32387f4e81bd7c863b544a787e Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_de4a5e32387f4e81bd7c863b544a787e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de4a5e32387f4e81bd7c863b544a787e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/de4a5e32387f4e81bd7c863b544a787e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/de4a5e32387f4e81bd7c863b544a787e"}]}] Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: de4a5e32387f4e81bd7c863b544a787e Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1530830610 Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestMinimumBasicScenario-1530830610-project Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 8508520adb904d4d8f390018299f68cd Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestMinimumBasicScenario-1530830610-project Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1612034992", "imageRef": "274eb36e-d8f6-41b8-b5b5-29ec4bdb66ee", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2117215898", "networks": [{"uuid": "51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0"}]}} Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:02.281181 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestMinimumBasicScenario-server-1612034992', 'imageRef': '274eb36e-d8f6-41b8-b5b5-29ec4bdb66ee', 'flavorRef': '452', 'key_name': 'tempest-TestMinimumBasicScenario-2117215898', 'networks': [{'uuid': '51ca8965-ebb4-46d5-aa1a-8f8bedab9ac0'}]}}} Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:02.284882 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-b028842d-c0c9-4f2d-b815-573a04af4761) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-1f655613-6856-47bf-bf93-2f4e24e0cf0e tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.284691 Nov 02 13:15:02.288789 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1039/2092] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:15:01 2022] POST /compute/v2.1/servers => generated 214 bytes in 286 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:15:02.292033 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-33a8eb0b-b20a-4873-a508-bfd7519254ac tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] Calling method '.version_select at 0x7eff5c5c21f0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:02.433319 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-33a8eb0b-b20a-4873-a508-bfd7519254ac tempest-TestMinimumBasicScenario-1530830610 tempest-TestMinimumBasicScenario-1530830610-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2117215898" status: 202 len: 0 microversion: 2.1 time: 0.145232 Nov 02 13:15:02.433923 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1054/2093] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Nov 2 13:15:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2117215898 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:17.046146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:17.241321 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-761b6fc6-5037-4a51-ac21-77b17a3d5b79 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: .version_select at 0x7eff57a31a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-762261168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSRBwxRvs6O5SOTfm/TlbohLcIhtwyq+/w2b3qf6wo3DOjUBmQkMfwli/y80CyI1LyyjpNs0V1LEGkDmbwM1Ie521HzO1ydMpKf57EwQ7M7rLauhhMc0eZNequRkreT9w=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:17.258932 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-761b6fc6-5037-4a51-ac21-77b17a3d5b79 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:17.264512 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-761b6fc6-5037-4a51-ac21-77b17a3d5b79 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for user 6137db77c8154928a3e0e57c0ecca3dc and project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:17.371206 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-761b6fc6-5037-4a51-ac21-77b17a3d5b79 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.326941 Nov 02 13:15:17.372078 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1040/2094] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:15:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:28.681203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:28.682341 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:28.688150 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1963169302", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "12e752bf-0419-48a0-a592-728a6c451a06"}], "key_name": "tempest-TestNetworkAdvancedServerOps-762261168", "security_groups": [{"name": "tempest-secgroup-smoke-217640815"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:28.871505 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] validate_networks() for [('12e752bf-0419-48a0-a592-728a6c451a06', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:29.229438 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376) Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:29.233989 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Request method failure captured: Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 343 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm1kvgNmIK9nJ1cilAYT8h-uDON_ug-O1qNS8Ia9eBOO1qjCyDnZsFWfHk0XfZMxHNjEScEXkHExgjc4I7ZUeavqSTi5ghPToyoiDFlidvE8WK-G-3YcbTtT4kRijrGFaAlk4SVxItT0Os-X4Gg79wl9LM1jhZi9IxNzgrrbL26bACQ Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef4f1f1efde142479f284d0edca2e143", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}] Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6137db77c8154928a3e0e57c0ecca3dc Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1963169302", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "12e752bf-0419-48a0-a592-728a6c451a06"}], "key_name": "tempest-TestNetworkAdvancedServerOps-762261168", "security_groups": [{"name": "tempest-secgroup-smoke-217640815"}]}} Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1963169302', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '12e752bf-0419-48a0-a592-728a6c451a06'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-762261168', 'security_groups': [{'name': 'tempest-secgroup-smoke-217640815'}]}}} Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:29.236729 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-cdd69b00-c46e-4d18-a0d9-87fafd5f2376) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:29.245775 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f1f5c1f9-4846-4551-9f59-5344eea4b65f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.561844 Nov 02 13:15:29.260134 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1055/2095] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:15:28 2022] POST /compute/v2.1/servers => generated 214 bytes in 573 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:15:34.551146 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:34.552724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:34.561881 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-982383df-7e52-4204-a59d-93c8eb8b586e tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Calling method '.version_select at 0x7eff606fc940>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:34.694580 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-982383df-7e52-4204-a59d-93c8eb8b586e tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762261168" status: 202 len: 0 microversion: 2.1 time: 0.146503 Nov 02 13:15:34.695432 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1041/2096] 10.222.0.64 () {58 vars in 1281 bytes} [Wed Nov 2 13:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-762261168 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:34.712421 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-afb17c30-b560-4402-bcb8-e934ad973ffb tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: .version_select at 0x7eff5c6c4d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2057509964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbHDyX9KO9j4JFZCidmoGpMvQPpRr5VeV993A5x0FnRD0YCCIpkPmHvTWYGBraFmuzNg0cA8Ktel1efwP56HBM4LjC+F+KyFYdaGwM1ryEj4BCdXsvnNI/zDwFSW3FtMg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:34.738161 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-afb17c30-b560-4402-bcb8-e934ad973ffb tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:34.748391 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-afb17c30-b560-4402-bcb8-e934ad973ffb tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for user 6137db77c8154928a3e0e57c0ecca3dc and project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:35.078685 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-afb17c30-b560-4402-bcb8-e934ad973ffb tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.370436 Nov 02 13:15:35.078685 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1056/2097] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:15:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:15:46.397185 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1764772719", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "fb5e414d-2685-4fbd-92b1-704c6054e918"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2057509964", "security_groups": [{"name": "tempest-secgroup-smoke-1094426152"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:46.536138 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] validate_networks() for [('fb5e414d-2685-4fbd-92b1-704c6054e918', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4768ea25-e425-4cb4-b0e6-8843124ba9f0) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:46.788989 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4768ea25-e425-4cb4-b0e6-8843124ba9f0) Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Request method failure captured: Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 345 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm1kvgNmIK9nJ1cilAYT8h-uDON_ug-O1qNS8Ia9eBOO1qjCyDnZsFWfHk0XfZMxHNjEScEXkHExgjc4I7ZUeavqSTi5ghPToyoiDFlidvE8WK-G-3YcbTtT4kRijrGFaAlk4SVxItT0Os-X4Gg79wl9LM1jhZi9IxNzgrrbL26bACQ Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef4f1f1efde142479f284d0edca2e143", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}] Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6137db77c8154928a3e0e57c0ecca3dc Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1764772719", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "fb5e414d-2685-4fbd-92b1-704c6054e918"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2057509964", "security_groups": [{"name": "tempest-secgroup-smoke-1094426152"}]}} Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:46.792762 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1764772719', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'fb5e414d-2685-4fbd-92b1-704c6054e918'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-2057509964', 'security_groups': [{'name': 'tempest-secgroup-smoke-1094426152'}]}}} Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:15:46.796228 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4768ea25-e425-4cb4-b0e6-8843124ba9f0) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:15:46.804054 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-082fde06-5277-4656-8acd-a4bc5ed878d7 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.402339 Nov 02 13:15:46.811408 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1042/2098] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:15:46 2022] POST /compute/v2.1/servers => generated 214 bytes in 415 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 13:15:51.781372 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:51.782324 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:15:51.783278 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:15:51.783620 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057509964 (ip 10.222.0.64) !!! Nov 02 13:15:51.785410 n-d-857339-6 devstack@n-api.service[127766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:15:51.785410 n-d-857339-6 devstack@n-api.service[127766]: Wed Nov 2 13:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057509964 (ip 10.222.0.64) !!! Nov 02 13:15:51.790024 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-9e1dae22-8c2a-41de-90ea-627ba47808ae tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Calling method '.version_select at 0x7eff5c726040>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:15:51.983399 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-9e1dae22-8c2a-41de-90ea-627ba47808ae tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057509964" status: 202 len: 0 microversion: 2.1 time: 0.202942 Nov 02 13:15:51.984011 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1057/2099] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2057509964 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:15:51.996545 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:15:51.997191 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 13:15:51.998597 n-d-857339-6 devstack@n-api.service[127767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 13:15:51.998778 n-d-857339-6 devstack@n-api.service[127767]: Wed Nov 2 13:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Nov 02 13:15:52.009169 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b61823f8-7479-48f9-910d-ddaad1661b42 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: .version_select at 0x7eff606fc550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1461840749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqZpazhUYcId5h/JSW0FVtRykTLZnhSvU8/s4L/DG3hntzhe/5oQ1bRQ9Az3F5oEcrR3g+EeAb2Pz+Hdn7DccXN4JJGk+wF5yFITIUR3auMW/A5jJ1202WpGJlWK9dkSA=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:15:52.041033 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b61823f8-7479-48f9-910d-ddaad1661b42 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:15:52.050773 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-b61823f8-7479-48f9-910d-ddaad1661b42 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for user 6137db77c8154928a3e0e57c0ecca3dc and project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:15:52.166159 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b61823f8-7479-48f9-910d-ddaad1661b42 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.172235 Nov 02 13:15:52.166804 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1043/2100] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:15:51 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 13:16:04.183725 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1163528114", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "cd7442b2-bd3b-4594-9c29-d948405f03d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1461840749", "security_groups": [{"name": "tempest-secgroup-smoke-1550947819"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:04.327070 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] validate_networks() for [('cd7442b2-bd3b-4594-9c29-d948405f03d1', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e7e37595-2a40-42c8-815e-73612445aaf8) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:04.633024 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e7e37595-2a40-42c8-815e-73612445aaf8) Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Request method failure captured: Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 345 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm1kvgNmIK9nJ1cilAYT8h-uDON_ug-O1qNS8Ia9eBOO1qjCyDnZsFWfHk0XfZMxHNjEScEXkHExgjc4I7ZUeavqSTi5ghPToyoiDFlidvE8WK-G-3YcbTtT4kRijrGFaAlk4SVxItT0Os-X4Gg79wl9LM1jhZi9IxNzgrrbL26bACQ Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef4f1f1efde142479f284d0edca2e143", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}] Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6137db77c8154928a3e0e57c0ecca3dc Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1163528114", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "cd7442b2-bd3b-4594-9c29-d948405f03d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1461840749", "security_groups": [{"name": "tempest-secgroup-smoke-1550947819"}]}} Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:04.637955 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1163528114', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': 'cd7442b2-bd3b-4594-9c29-d948405f03d1'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1461840749', 'security_groups': [{'name': 'tempest-secgroup-smoke-1550947819'}]}}} Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:04.643562 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-e7e37595-2a40-42c8-815e-73612445aaf8) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:04.649710 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-f84da46d-91f1-4ca1-87d8-21791a4b131f tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.459155 Nov 02 13:16:04.653430 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1058/2101] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:16:04 2022] POST /compute/v2.1/servers => generated 214 bytes in 473 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:16:09.303567 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:09.313598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:09.313598 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-b1f91a46-d932-419b-b535-dc0d833b98ed tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Calling method '.version_select at 0x7eff57a09af0>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:09.393331 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-b1f91a46-d932-419b-b535-dc0d833b98ed tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1461840749" status: 202 len: 0 microversion: 2.1 time: 0.091242 Nov 02 13:16:09.393935 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1044/2102] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1461840749 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:09.408101 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-0b91c01e-4f93-43e3-982a-1125f53a5191 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: .version_select at 0x7eff5c19dca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-798488634", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRk/M6DDiRHPb4FS2AUJLHU1mqsbBy++OJ3t61msJhtVgMwlqrX7ccKXIYIeQ6neqy12n5yLKtfaKQVWc5VgSbZgTlttocTaWDnLEslcLNMJPR0t9MLNfPPmXfUBUix9g=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:09.428355 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0b91c01e-4f93-43e3-982a-1125f53a5191 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:09.434029 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-0b91c01e-4f93-43e3-982a-1125f53a5191 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for user 6137db77c8154928a3e0e57c0ecca3dc and project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:09.579488 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-0b91c01e-4f93-43e3-982a-1125f53a5191 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.175366 Nov 02 13:16:09.580034 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1059/2103] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:16:09 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:21.017749 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2079161615", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5e190b86-688a-4371-92e4-e4688e1dbae2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-798488634", "security_groups": [{"name": "tempest-secgroup-smoke-1983073770"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:21.187533 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] validate_networks() for [('5e190b86-688a-4371-92e4-e4688e1dbae2', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ade8a108-e096-4c41-adae-e4555828e450) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:21.866245 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ade8a108-e096-4c41-adae-e4555828e450) Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Request method failure captured: Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 344 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm1kvgNmIK9nJ1cilAYT8h-uDON_ug-O1qNS8Ia9eBOO1qjCyDnZsFWfHk0XfZMxHNjEScEXkHExgjc4I7ZUeavqSTi5ghPToyoiDFlidvE8WK-G-3YcbTtT4kRijrGFaAlk4SVxItT0Os-X4Gg79wl9LM1jhZi9IxNzgrrbL26bACQ Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef4f1f1efde142479f284d0edca2e143", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}] Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 6137db77c8154928a3e0e57c0ecca3dc Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2079161615", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "5e190b86-688a-4371-92e4-e4688e1dbae2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-798488634", "security_groups": [{"name": "tempest-secgroup-smoke-1983073770"}]}} Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:21.869642 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-2079161615', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '5e190b86-688a-4371-92e4-e4688e1dbae2'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-798488634', 'security_groups': [{'name': 'tempest-secgroup-smoke-1983073770'}]}}} Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:21.875578 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-ade8a108-e096-4c41-adae-e4555828e450) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-4ce4375a-7646-4561-b213-b696a3d20568 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.851757 Nov 02 13:16:21.885836 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1045/2104] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:16:21 2022] POST /compute/v2.1/servers => generated 214 bytes in 853 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:16:26.577362 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:26.590770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:26.590770 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-cea436b3-4bc6-4ebf-a0a3-9289ca7e9889 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Calling method '.version_select at 0x7eff5c2144c0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:26.749763 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-cea436b3-4bc6-4ebf-a0a3-9289ca7e9889 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-798488634" status: 202 len: 0 microversion: 2.1 time: 0.173528 Nov 02 13:16:26.750359 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1060/2105] 10.222.0.64 () {58 vars in 1281 bytes} [Wed Nov 2 13:16:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-798488634 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:16:26.766045 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c5affe2e-3c47-4b0a-9799-48b15fb36dc6 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: .version_select at 0x7eff57a0c1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1694077498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqYuGr6YUFFkEqOBOyWFe4YTiEvjPZ0oV0M94UlmAH+sfWpn8RrfgfXp8Ie0UifXw+oCIfG/scELOJytujVheDmygwo/fyyfweo+Ictd4uCGPGwCZmhwV9b4QVxXWR2qw=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:26.784853 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c5affe2e-3c47-4b0a-9799-48b15fb36dc6 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:16:26.790396 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-c5affe2e-3c47-4b0a-9799-48b15fb36dc6 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Getting quotas for user 6137db77c8154928a3e0e57c0ecca3dc and project ef4f1f1efde142479f284d0edca2e143. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:16:27.010335 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c5affe2e-3c47-4b0a-9799-48b15fb36dc6 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.248819 Nov 02 13:16:27.011210 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1046/2106] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:16:26 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:16:38.920883 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1923785345", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "042e1d40-2925-4c5f-bcc4-21ca4b1d0681"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1694077498", "security_groups": [{"name": "tempest-secgroup-smoke-1499242398"}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:16:39.082203 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] validate_networks() for [('042e1d40-2925-4c5f-bcc4-21ca4b1d0681', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27ffd852-6d5e-4598-a5bb-9704c93cfc56) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:39.338685 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27ffd852-6d5e-4598-a5bb-9704c93cfc56) Nov 02 13:16:39.342538 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.345325 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:39.345325 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Request method failure captured: Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 345 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm1kvgNmIK9nJ1cilAYT8h-uDON_ug-O1qNS8Ia9eBOO1qjCyDnZsFWfHk0XfZMxHNjEScEXkHExgjc4I7ZUeavqSTi5ghPToyoiDFlidvE8WK-G-3YcbTtT4kRijrGFaAlk4SVxItT0Os-X4Gg79wl9LM1jhZi9IxNzgrrbL26bACQ Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ef4f1f1efde142479f284d0edca2e143", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ef4f1f1efde142479f284d0edca2e143"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ef4f1f1efde142479f284d0edca2e143"}]}] Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: ef4f1f1efde142479f284d0edca2e143 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-913013090 Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 6137db77c8154928a3e0e57c0ecca3dc Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestNetworkAdvancedServerOps-913013090-project Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1923785345", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "networks": [{"uuid": "042e1d40-2925-4c5f-bcc4-21ca4b1d0681"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1694077498", "security_groups": [{"name": "tempest-secgroup-smoke-1499242398"}]}} Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestNetworkAdvancedServerOps-server-1923785345', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'networks': [{'uuid': '042e1d40-2925-4c5f-bcc4-21ca4b1d0681'}], 'key_name': 'tempest-TestNetworkAdvancedServerOps-1694077498', 'security_groups': [{'name': 'tempest-secgroup-smoke-1499242398'}]}}} Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:16:39.347863 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-27ffd852-6d5e-4598-a5bb-9704c93cfc56) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:39.352089 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-57d36757-064b-4ec9-9ed5-aff49610deb5 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.433333 Nov 02 13:16:39.357306 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1061/2107] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:16:38 2022] POST /compute/v2.1/servers => generated 214 bytes in 435 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:16:43.503170 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-c6def486-26c4-437c-9a71-8ffff7fd62c3 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] Calling method '.version_select at 0x7eff57a27f70>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:16:43.516371 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:43.517255 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:16:43.609523 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-c6def486-26c4-437c-9a71-8ffff7fd62c3 tempest-TestNetworkAdvancedServerOps-913013090 tempest-TestNetworkAdvancedServerOps-913013090-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694077498" status: 202 len: 0 microversion: 2.1 time: 0.111861 Nov 02 13:16:43.610120 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1047/2108] 10.222.0.64 () {58 vars in 1284 bytes} [Wed Nov 2 13:16:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1694077498 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:02.421108 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:02.653685 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-df4be45b-e64e-48d7-a7f8-845da8af3a72 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Action: 'create', calling method: .version_select at 0x7eff608b2670>, body: {"keypair": {"name": "tempest-TestShelveInstance-713189712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/bmzwa6Tbay3jVmVq3XL4dATh8VQRPyEsFWnc2SEtYB3PWKxyloHcJiKvQI9T5qkeCrH+k1+Nfb+2Wl4iQeHaKAuVDviEAA/mW2bp9E4vLtW6trWwB+x/XvSGscJWFZg=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:02.673256 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-df4be45b-e64e-48d7-a7f8-845da8af3a72 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Getting quotas for project 9e3de9fd53764accb2dd11608029c233. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:02.679509 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-df4be45b-e64e-48d7-a7f8-845da8af3a72 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Getting quotas for user 98eab8120e6548789f45589fa8530762 and project 9e3de9fd53764accb2dd11608029c233. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:02.789012 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-df4be45b-e64e-48d7-a7f8-845da8af3a72 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.369392 Nov 02 13:17:02.790012 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1062/2109] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:17:02 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:06.360735 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-629016198", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-713189712", "security_groups": [{"name": "tempest-secgroup-smoke-30577"}], "networks": [{"uuid": "0da7da1a-1676-4b95-ab9f-566c3aa29ee3"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:06.609500 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] validate_networks() for [('0da7da1a-1676-4b95-ab9f-566c3aa29ee3', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59b4d133-da42-4850-a40d-dfa4caf412f6) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:17:06.845016 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59b4d133-da42-4850-a40d-dfa4caf412f6) Nov 02 13:17:06.848947 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.851853 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:06.851853 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Request method failure captured: Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 318 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm3GCLTlGZjYAqcSz9-RECBJUtPoHahPDCxitKbK0-47zNlvxZLrF4LMZ04RplEJ4P2yPxRij33ZFZglTjJrxW-Ug6eKg8-wXvjg55BKgbwa97R_rGSo3w2o13MkruiUMYng1P6OXwMen-lIxc-Rx_NNjxax-1m_op1iVu1lFZqxBPE Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 9e3de9fd53764accb2dd11608029c233 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestShelveInstance-727225336 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9e3de9fd53764accb2dd11608029c233", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9e3de9fd53764accb2dd11608029c233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9e3de9fd53764accb2dd11608029c233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9e3de9fd53764accb2dd11608029c233"}]}] Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestShelveInstance-727225336 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 9e3de9fd53764accb2dd11608029c233 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestShelveInstance-727225336 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestShelveInstance-727225336-project Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: 98eab8120e6548789f45589fa8530762 Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestShelveInstance-727225336-project Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestShelveInstance-server-629016198", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-713189712", "security_groups": [{"name": "tempest-secgroup-smoke-30577"}], "networks": [{"uuid": "0da7da1a-1676-4b95-ab9f-566c3aa29ee3"}]}} Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-629016198', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-713189712', 'security_groups': [{'name': 'tempest-secgroup-smoke-30577'}], 'networks': [{'uuid': '0da7da1a-1676-4b95-ab9f-566c3aa29ee3'}]}}} Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:17:06.855611 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-59b4d133-da42-4850-a40d-dfa4caf412f6) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:06.859030 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.864356 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:17:06.867074 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:06.867074 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:06.867931 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-27c31f4b-e07c-4134-856e-29820459c493 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.512389 Nov 02 13:17:06.868596 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1048/2110] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:17:06 2022] POST /compute/v2.1/servers => generated 214 bytes in 514 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0) Nov 02 13:17:07.166662 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-aa1dc919-7239-41d4-92cd-9b42fb38c06a tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Calling method '.version_select at 0x7eff5c6c43a0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:07.364053 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-aa1dc919-7239-41d4-92cd-9b42fb38c06a tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-713189712" status: 202 len: 0 microversion: 2.1 time: 0.214451 Nov 02 13:17:07.365058 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1063/2111] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 13:17:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-713189712 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:17:07.384345 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-9da40cb5-99d0-4bf6-bff6-d34acd548f34 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Action: 'create', calling method: .version_select at 0x7eff606fcd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-2040182551", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsNCZm9jlF1VjKd8emPIrOAmGiIuv8c26Z1T+2H9C8TNQhRHUWaqtWdSemkJ5T1Ub7/2e/s58XPkVylWOrgF4eOQ1Tmvr/BGDudMjCQv9EAbRC1KX94+CrMOON5QPWhww=="}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:07.399724 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-9da40cb5-99d0-4bf6-bff6-d34acd548f34 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Getting quotas for project 9e3de9fd53764accb2dd11608029c233. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:17:07.408112 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.quota [None req-9da40cb5-99d0-4bf6-bff6-d34acd548f34 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Getting quotas for user 98eab8120e6548789f45589fa8530762 and project 9e3de9fd53764accb2dd11608029c233. Resources: {'key_pairs'} {{(pid=127767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:17:07.579008 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-9da40cb5-99d0-4bf6-bff6-d34acd548f34 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.204500 Nov 02 13:17:07.579626 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1049/2112] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:17:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:17:36.071648 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_cell0:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:36.072398 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:36.077173 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-819732917", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2040182551", "security_groups": [{"name": "tempest-secgroup-smoke-1969933258"}], "networks": [{"uuid": "0da7da1a-1676-4b95-ab9f-566c3aa29ee3"}], "block_device_mapping_v2": [{"uuid": "37d06bc5-1f7e-4d4d-bdd1-c2eac09c6eec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:17:36.491215 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.network.neutron [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] validate_networks() for [('0da7da1a-1676-4b95-ab9f-566c3aa29ee3', None, None, None, None, None)] {{(pid=127766) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c002a6e-3125-4f1f-bf70-4ac8395f515a) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:17:36.800812 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c002a6e-3125-4f1f-bf70-4ac8395f515a) Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.wsgi [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Request method failure captured: Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Accept: application/json Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Accept-Encoding: identity Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Connection: close Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Content-Length: 470 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Content-Type: application/json Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Host: 10.222.0.64 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Openstack-System-Scope: None Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: User-Agent: python-urllib3/1.26.12 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Auth-Token: gAAAAABjYm3GCLTlGZjYAqcSz9-RECBJUtPoHahPDCxitKbK0-47zNlvxZLrF4LMZ04RplEJ4P2yPxRij33ZFZglTjJrxW-Ug6eKg8-wXvjg55BKgbwa97R_rGSo3w2o13MkruiUMYng1P6OXwMen-lIxc-Rx_NNjxax-1m_op1iVu1lFZqxBPE Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Id: None Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Domain-Name: None Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Identity-Status: Confirmed Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Is-Admin-Project: True Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Id: default Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Domain-Name: Default Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Id: 9e3de9fd53764accb2dd11608029c233 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Project-Name: tempest-TestShelveInstance-727225336 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Role: reader,member Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Roles: reader,member Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9e3de9fd53764accb2dd11608029c233", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9e3de9fd53764accb2dd11608029c233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9e3de9fd53764accb2dd11608029c233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9e3de9fd53764accb2dd11608029c233"}]}] Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant: tempest-TestShelveInstance-727225336 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Id: 9e3de9fd53764accb2dd11608029c233 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-Tenant-Name: tempest-TestShelveInstance-727225336 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-User: tempest-TestShelveInstance-727225336-project Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Id: default Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-User-Domain-Name: Default Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-User-Id: 98eab8120e6548789f45589fa8530762 Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: X-User-Name: tempest-TestShelveInstance-727225336-project Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: {"server": {"name": "tempest-TestShelveInstance-server-819732917", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2040182551", "security_groups": [{"name": "tempest-secgroup-smoke-1969933258"}], "networks": [{"uuid": "0da7da1a-1676-4b95-ab9f-566c3aa29ee3"}], "block_device_mapping_v2": [{"uuid": "37d06bc5-1f7e-4d4d-bdd1-c2eac09c6eec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: method: > Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:36.808626 n-d-857339-6 devstack@n-api.service[127766]: Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: action_args: {'body': {'server': {'name': 'tempest-TestShelveInstance-server-819732917', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestShelveInstance-2040182551', 'security_groups': [{'name': 'tempest-secgroup-smoke-1969933258'}], 'networks': [{'uuid': '0da7da1a-1676-4b95-ab9f-566c3aa29ee3'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': True, 'volume_id': '37d06bc5-1f7e-4d4d-bdd1-c2eac09c6eec'}]}}} Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:17:36.815964 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-9c002a6e-3125-4f1f-bf70-4ac8395f515a) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: ERROR nova.api.openstack.wsgi Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: {{(pid=127766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-861f9ba4-a908-4f3e-b457-bf685eb531a7 tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.739350 Nov 02 13:17:36.823640 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1064/2113] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:17:36 2022] POST /compute/v2.1/servers => generated 214 bytes in 741 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 13:17:37.169402 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-0ba96cf9-c1ff-4efe-bd6b-3bb53666692c tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] Calling method '.version_select at 0x7eff57a0c550>' {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:17:37.176135 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_cell0:SELECT=4 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:37.176982 n-d-857339-6 devstack@n-api.service[127767]: DEBUG dbcounter [-] [127767] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:17:37.308667 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-0ba96cf9-c1ff-4efe-bd6b-3bb53666692c tempest-TestShelveInstance-727225336 tempest-TestShelveInstance-727225336-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2040182551" status: 202 len: 0 microversion: 2.1 time: 0.143431 Nov 02 13:17:37.309290 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1050/2114] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Nov 2 13:17:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2040182551 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 13:18:05.847464 n-d-857339-6 devstack@n-api.service[127766]: DEBUG dbcounter [-] [127766] Writing DB stats nova_api:SELECT=4 {{(pid=127766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 13:18:06.043571 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-b79bab97-9f6f-4527-85ac-2c8f769f88b5 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Action: 'create', calling method: .version_select at 0x7eff5c2144c0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-15883702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/xyHmRgz3Vi6q5iA1QYENOBMn4jo6EGcwTVVzHDwaCf+kf9aSren1HJi601Wvts4EDr2hHH9j9Z2mUSCtwFG0xdudWLVNH8xpowq1en2RDtAwZrwWB/9OBlTDieMUuTA=="}} {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:06.061937 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-b79bab97-9f6f-4527-85ac-2c8f769f88b5 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Getting quotas for project 045c48f108df42c9b839fa7b5ce32cea. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 13:18:06.068228 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.quota [None req-b79bab97-9f6f-4527-85ac-2c8f769f88b5 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Getting quotas for user f9de36669f8b420299e8efbf62442d9b and project 045c48f108df42c9b839fa7b5ce32cea. Resources: {'key_pairs'} {{(pid=127766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 13:18:06.278755 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-b79bab97-9f6f-4527-85ac-2c8f769f88b5 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.432163 Nov 02 13:18:06.279277 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1065/2115] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Nov 2 13:18:05 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 13:18:10.390369 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-480810308", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-15883702", "security_groups": [{"name": "tempest-secgroup-smoke-513142019"}], "networks": [{"uuid": "87f2a1ed-86c4-4a8a-87d0-93daaaaf0c57"}]}} {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 13:18:10.505844 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.network.neutron [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] validate_networks() for [('87f2a1ed-86c4-4a8a-87d0-93daaaaf0c57', None, None, None, None, None)] {{(pid=127767) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Unexpected exception in API method: keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3f6be90-4f40-4840-b3e9-80478d57eefb) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:18:10.712709 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3f6be90-4f40-4840-b3e9-80478d57eefb) Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.wsgi [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Request method failure captured: Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: request: POST /compute/v2.1/servers HTTP/1.1 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Accept: application/json Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Accept-Encoding: identity Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Connection: close Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Content-Length: 323 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Content-Type: application/json Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Host: 10.222.0.64 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Openstack-System-Scope: None Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: User-Agent: python-urllib3/1.26.12 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Auth-Token: gAAAAABjYm4FHewxGV3pG7PsjyFBWSng_30d9Exu1dcQNq0WWLQMdalVsSYC51lTYAP0vlr1SuQwv-reYbymALD8tWu0plmopnd-ZI3BfyTGTIoipJjTvJHWK2ygAuW586ix4UDWgQZQ3oSmpXAr5BXrXrFVNUqCmIHcPsTBNz46bXN-Fzu8wjg Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Id: None Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Domain-Name: None Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Identity-Status: Confirmed Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Is-Admin-Project: True Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Id: default Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Domain-Name: Default Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Id: 045c48f108df42c9b839fa7b5ce32cea Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Project-Name: tempest-TestSnapshotPattern-1908581614 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Role: reader,member Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Roles: reader,member Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_045c48f108df42c9b839fa7b5ce32cea", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/045c48f108df42c9b839fa7b5ce32cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/045c48f108df42c9b839fa7b5ce32cea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/045c48f108df42c9b839fa7b5ce32cea"}]}] Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant: tempest-TestSnapshotPattern-1908581614 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Id: 045c48f108df42c9b839fa7b5ce32cea Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-Tenant-Name: tempest-TestSnapshotPattern-1908581614 Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-User: tempest-TestSnapshotPattern-1908581614-project Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Id: default Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Domain-Name: Default Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Id: f9de36669f8b420299e8efbf62442d9b Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: X-User-Name: tempest-TestSnapshotPattern-1908581614-project Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: {"server": {"name": "tempest-TestSnapshotPattern-server-480810308", "imageRef": "f990171d-1f62-41c4-b6db-f21083f74067", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-15883702", "security_groups": [{"name": "tempest-secgroup-smoke-513142019"}], "networks": [{"uuid": "87f2a1ed-86c4-4a8a-87d0-93daaaaf0c57"}]}} Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: method: > Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: exception: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:18:10.716610 n-d-857339-6 devstack@n-api.service[127767]: Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: action_args: {'body': {'server': {'name': 'tempest-TestSnapshotPattern-server-480810308', 'imageRef': 'f990171d-1f62-41c4-b6db-f21083f74067', 'flavorRef': '452', 'key_name': 'tempest-TestSnapshotPattern-15883702', 'security_groups': [{'name': 'tempest-secgroup-smoke-513142019'}], 'networks': [{'uuid': '87f2a1ed-86c4-4a8a-87d0-93daaaaf0c57'}]}}} Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._create_instance( Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1116, in _validate_and_build_base_options Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi result = self.network_api.create_resource_requests( Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2273, in create_resource_requests Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.has_extended_resource_request_extension(context, neutron)) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1408, in has_extended_resource_request_extension Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._has_extension( Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1382, in _has_extension Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._refresh_neutron_extensions_cache(client) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 1366, in _refresh_neutron_extensions_cache Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi extensions_list = client.list_extensions()['extensions'] Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 806, in list_extensions Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get(self.extensions_path, params=_params) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 284, in do_request Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp, replybody = self.httpclient.do_request(action, method, body=body, Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 341, in do_request Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self._check_uri_length(url) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 334, in _check_uri_length Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi uri_len = len(self.endpoint_url) + len(url) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/client.py", line 348, in endpoint_url Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.get_endpoint() Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 291, in get_endpoint Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.session.get_endpoint(auth or self.auth, **kwargs) Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1243, in get_endpoint Nov 02 13:18:10.720433 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return auth.get_endpoint(self, **kwargs) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 375, in get_endpoint Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi endpoint_data = self.get_endpoint_data( Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 271, in get_endpoint_data Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi service_catalog = self.get_access(session).service_catalog Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/base.py", line 134, in get_access Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi self.auth_ref = self.get_auth_ref(session) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/generic/base.py", line 208, in get_auth_ref Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self._plugin.get_auth_ref(session, **kwargs) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/identity/v3/base.py", line 187, in get_auth_ref Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi resp = session.post(token_url, json=body, headers=headers, Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1149, in post Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return self.request(url, 'POST', **kwargs) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 986, in request Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, method, url) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi keystoneauth1.exceptions.http.BadRequest: Expecting to find domain in project. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-c3f6be90-4f40-4840-b3e9-80478d57eefb) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 706, in wrapped Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPInternalServerError(explanation=msg) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: ERROR nova.api.openstack.wsgi Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: DEBUG nova.api.openstack.wsgi [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: {{(pid=127767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: INFO nova.api.openstack.requestlog [None req-8adb1240-8993-4566-beee-82a454235478 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 500 len: 214 microversion: 2.1 time: 0.331738 Nov 02 13:18:10.723963 n-d-857339-6 devstack@n-api.service[127767]: [pid: 127767|app: 0|req: 1051/2116] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Nov 2 13:18:10 2022] POST /compute/v2.1/servers => generated 214 bytes in 333 msecs (HTTP/1.1 500) 9 headers in 391 bytes (2 switches on core 0) Nov 02 13:18:10.960920 n-d-857339-6 devstack@n-api.service[127766]: DEBUG nova.api.openstack.wsgi [None req-58e774c2-d609-46e6-9527-49933d00ab89 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] Calling method '.version_select at 0x7eff5c19daf0>' {{(pid=127766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 13:18:11.135507 n-d-857339-6 devstack@n-api.service[127766]: INFO nova.api.openstack.requestlog [None req-58e774c2-d609-46e6-9527-49933d00ab89 tempest-TestSnapshotPattern-1908581614 tempest-TestSnapshotPattern-1908581614-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-15883702" status: 202 len: 0 microversion: 2.1 time: 0.182366 Nov 02 13:18:11.136268 n-d-857339-6 devstack@n-api.service[127766]: [pid: 127766|app: 0|req: 1066/2117] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Nov 2 13:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-15883702 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)